Announcing the SAVIYNT KNOWLEDGE EXCHANGE unifying the Saviynt forums, documentation, training, and more in a single search tool across platforms. Click HERE to read the Announcement.

Functioning of Incremental Imports in Comparison to Full Import

VicyB
Regular Contributor
Regular Contributor

Hello everybody,

when implementing import jobs, the documentation strongly differentiates between the full import and the incremental import job.

The full import focuses on the initial data import while the incremental import is implemented as delta import (taking into account the results of the last import instead of "blindly" importing everything as mentioned in this forum entry).

However, not mentioned in the documentation are the differences in functioning especially as the incremental import seems to work in loops and sometimes takes much longer than the full import job.

How does the algorithm of incremental import jobs work in comparison to the full import algorithm?

Thank you!

5 REPLIES 5

SB
Saviynt Employee
Saviynt Employee

The only difference between incremental import and Full is the data volume. The incremental import will only bring the data that was updated post the last job run time and should always take less time then a full import. In case the incremental import is taking more time than the full job, than we need to identify if any other job is impacting the job run time.


Regards,
Sahil

VicyB
Regular Contributor
Regular Contributor

Interestingly, we found a situation in which the incremental import job takes more time:

For the entitlement import from Active Directory, the incremental import job takes longer than the full import - if we enable AccountLinking via performGroupAccountLinking parameter in the groupImportMapping.

If AccountLinking is enabled, the incremental import job runs for hours instead of seconds, which is basically the origin for our interest in the algorithm differences.

Please note: Another job can't impact this incremental import job because we have a separate connection for this job (recommended by SAV Support to handle issues like data overload).

Is the AccountLinking in the Incremental Import Job (for entitlement import from AD) performed differently than in the Full Import Job?

 

Thank you for the insights!

SB
Saviynt Employee
Saviynt Employee

The incremental job should not ideally take more time than the full since it is only importing a subset of the entire data. I would recommend to log a ticket with Support Team to get this checked.


Regards,
Sahil

VicyB
Regular Contributor
Regular Contributor

Hello Sahil,

yes, we have been working on this issue with the Support Team and SME Support since February.

As solution, we can only remove the accountlinking from the incremental import to have a reasonable runtime. If we enable accountlinking, the incremental job takes around 3 hours, compared to 8 minutes that the full import takes.

SB
Saviynt Employee
Saviynt Employee

Probably the support team can work with Engg to get this enhanced.


Regards,
Sahil