07/12/2022 10:54 AM
Hi,
Problem Description: We are running user import via REST connector from workday. Import is via RAAS report which is always feeding full data to saviynt as their is no filed at workday end which filters only created user or updated user.
At the same time there are preprocessing that we are doing via inline processing java code for each record. As there are dependent attribute like manager username,status,citycode and other calculation that should be based on certain data. Also these computed attribute are not being synced back.
There is a use case of special character conversion where we are checking all records ,if it is new we are converting it and if it is old then we take whatever present in saviynt.
All these pre processing is negatively impacting user import time.
Ask: Is there a way by which we can identify user changes by comparing what ever data we have in our current user base so that we can restrict this pre processing on only few records?
Thanks
07/13/2022 06:01 AM
Hi @ashutosh ,
This has to preferably be solved at the target. Its common practice to have smaller RaaS reports generated which only have changes/updated users and schedule the import via those reports via a separate connection.
In the use case and constraint that you have mentioned, there can be a bit of performance improvement depending on how you write your preprocessor.
1. New Users --> Compare list of current users with users in the import feed and add them to a list to run preprocessor query on.
2. Updated Users --> Compare list of current users with users in the feed based on limited attributes that can get changed and add them to a list to run preprocessor query on.
The goal would be to identify user list for changes and new creation and only run query for those instead of all.
This will ideally be possible via a jar be preprocessor.
This being said, the preferred solution is to get the reports created as required at the target.
07/13/2022 06:09 AM
Hi Sahaj,
Is it possible to do pre processing by combination of sql queries and java code. Like few computation by sql queries and few by java code ?
Thanks
07/13/2022 06:14 AM
Hello,
It would be easier to do it all in the java preprocessor. We do have the ability to do sql and java together but in that scenario, both are evaluated one after the other.