Ideal frequency for Full Import Jobs

[Jaya]

Hi Team,

We have scheduled Full application data(account/access) Jobs twice a day & each jobs takes approx 3 hours of time for completion.

Although we have scheduled delta(incremental) jobs for every 1-2 hours.

So my question is what should be the Ideal frequency of Full import Jobs, if incremental Jobs are scheduled at less interval of time.

As because of these full import job, other jobs are getting overlapped.

[naveenss]

Hi @Jaya  if you're running incremental jobs every 1-2 hours, then its better to have full imports to run over the weekend. 

[Jegathalayan_T]

Hi @Jaya 

More information on Job Management Best-practices can be found here:

https://forums.saviynt.com/t5/job-control-panel/best-practices-for-jobs-trigger-management/ta-p/3640...

if incremental jobs are more frequent then Full import can be scheduled when it won't overlap. In-order to avoid Full Import Jobs Overlap incase it's scheduled on the weekends, please try to couple them in trigger chain jobs in moderation(not too many).

Thank you and Regards,

Jegathalayan T

[prashantv45]

@Jaya 
If the incremental import is scheduled on 2-3 times on daily basis then its better to run the Full Imports on Weekend. This will help in keeping the system in sync and also it will not impact the business.
Regards,
Prashant

[rushikeshvartak]

• You can schedule incremental every 2 hohrs and not between 2-5 am in night for example.
• full import can be run between 2-5 am 

this will avoid job overlap 

[Jaya]

Thanks everyone for your responses & it makes sense to run full import over weekends.

@rushikeshvartak  - But how do we restrict incremental job for 3 hours if we configure to run it every 2 hour.

[rushikeshvartak]

• Since you will be running Full import during that time dont run incremental import 
• You can exclude certain hours from using cron expression..
• You can also check average time Full Import takes