Saviynt unveils its cutting-edge Intelligence Suite products to revolutionize Identity Security!
Click HERE to see how Saviynt Intelligence is transforming the industry.
Saviynt Copilot Icon

Efficiently Fetching User Data on a Weekly and Daily Basis (Delta Transfer)

Roua
Regular Contributor
Regular Contributor

Hello everyone,

I'm working on a requirement and would appreciate some advice or alternative approaches. Here is the logic I'm trying to implement:

  • Weekly Full Data Fetch: Once a week, fetch the complete set of user data.
  • Daily Delta Fetch: On a daily basis, fetch only the user data that has been updated or changed since the previous day.

I've considered using the following URL pattern to fetch the data in the ImportUserJSON code in the HCM connection:

 

"url":"https://example${#if(${date:format('E')} == 'Sun')?'':'?$filter=TmstpDate eq ' + ${date:format('yyyyMMdd', ${date:add(-1)})}}"

 

I am not sure if this approach is supported in this case. Is there a different way or a better approach to achieve this requirement?

Any suggestions or recommendations would be greatly appreciated!

Thank you!

3 REPLIES 3

rushikeshvartak
All-Star
All-Star
  • This is totally based on your trusted source if trusted source support api filter
  •  

Regards,
Rushikesh Vartak
If this helped you move forward, click 'Kudos'. If it solved your query, select 'Accept As Solution'.

Roua
Regular Contributor
Regular Contributor

It didn't work so i tried again to use this method by adding this to my ImportUserJSON:

"javascript": {
  "beforeExecution": "let today = new Date();\nlet dayOfWeek = today.getDay();\nif (dayOfWeek === 0) {\n  this.url = 'https://example';\n} else {\n  let yesterday = new Date(today);\n  yesterday.setDate(today.getDate() - 1);\n  let formattedDate = `${yesterday.getFullYear()}${('0' + (yesterday.getMonth() + 1)).slice(-2)}${('0' + yesterday.getDate()).slice(-2)}`;\n  this.url = `https://example?$filter=TmstpDate eq '${formattedDate}'`;\n}"
  }

 the connection worked after running the Job, but now i am not sure how to actually tell which users were updated or how to find out that the filtering method of this javascript to calculate the URL before making the request worked?

Does target application support filter !

Please share postman screenshot and curl command [Refer https://codingnconcepts.com/postman/how-to-generate-curl-command-from-postman/ ]



⚠️‼️‼️Do not upload any attachments that contain sensitive information, such as IP Addresses, URLs, Company/Employee Names, Email Addresses, etc.‼️‼️⚠️


Regards,
Rushikesh Vartak
If this helped you move forward, click 'Kudos'. If it solved your query, select 'Accept As Solution'.