03/27/2023 10:30 AM
Hi Team,
We are using below ImportAccountEntJSON in our REST connector but after running the Application Data Import (Single Threaded) we are getting maximum 500 records. Looks like there is some issue with the pagination. please assist.
{
"accountParams": {
"connection": "acctAuth",
"processingType": "SequentialAndIterative",
"call": {
"call1": {
"callOrder": 0,
"stageNumber": 0,
"http": {
"url": "https://localhost-dev.saviyntcloud.com/ECM/api/v5/getUser",
"httpHeaders": {
"Authorization": "${access_token}"
},
"httpContentType": "application/json",
"httpMethod": "POST",
"httpParams": "{\"responsefields\":[\"username\"],\"userQuery\":\"statuskey = 1\"}"
},
"listField": "userdetails",
"keyField": "accountID",
"colsToPropsMap": {
"accountID": "username~#~char",
"name": "username~#~char"
},
"pagination": {
"offset": {
"offsetParam": "offset",
"batchParam": "max",
"batchSize": 1000,
"totalCountPath": "totalcount"
}
}
}
}
}
}
Solved! Go to Solution.
03/27/2023 10:38 PM
Hi @vermark
The json looks correct, can you keep the batchsize as 500 and totalacountpath as high number ( ex: 999999).
Also if you call via postman max column allows you to get 500 data in one call, you can increase this upto 5000 as well in the config table if you need )
you can check the value by this sql: select configdata from configuration where name = 'Ws_max_records_returned'. if this is 500 then use the custom query job to get it updated to 5000 and then try to call the Api via postman keeping max as 5000 you will be able to 5000 data in one call and then you can put the batch size accordingly.
Thanks
Darshan