Announcing the Saviynt Knowledge Exchange unifying the Saviynt forums, documentation, training,
and more in a single search tool across platforms. Read the announcement here.

reconciliate job stops after 50 minutes

Antoine
Regular Contributor
Regular Contributor

Hello, 

We need to reconciliate a large amount of accounts (8000) .

The target system is not able to handle a pagination mechanism . ALl accounts are sent in one call.

The job stops with no error. 

We change the configuration to try to make it works

There is no difference in the execution  if I tried this 2 configurations


    "connectionTimeout": 10,
    "readTimeout": 200,
    "writeTimeout":200,
    "retryWait": 2,
    "retryCount": 3

    "connectionTimeout": 1000,
    "readTimeout": 7200,
    "writeTimeout":1000,
    "retryWait": 2,
    "retryCount": 3

The error seems to be related to the memory used for retreiving and handling the accounts by the reconciliate process not from getting the response from the API (We got the reponse in around 2 seconds)

Regards

Antoine 

11 REPLIES 11

Manu269
All-Star
All-Star

@Antoine can you add more details :

1. Connector Type?

2. Is there any capability for Paging from App?

3. Via Postman, how many records are shown in 1 hit?

Regards
Manish Kumar
If the response answered your query, please Accept As Solution and Kudos
.

Antoine
Regular Contributor
Regular Contributor

Hello, 

It is a Rest connector

Actually there is no Paging available from app .

in postman, the response contains 8676 accounts.

 

 

rushikeshvartak
All-Star
All-Star

Increase readTimeout


Regards,
Rushikesh Vartak
If you find this response useful, kindly consider selecting 'Accept As Solution' and clicking on the 'Kudos' button.

Antoine
Regular Contributor
Regular Contributor

readtimeout is set to the max value 7200

We have some custom configuration in the json for mapping 

"customproperty9":"#CONST#${
String data = response;
Status = data.split(\",'\")[1];
Status = Status.split(':')[1];
Status = Status.replace(\"'\",\"\");
return Status.substring(1, Status.length())}~#~char",

We did this conf for the 10 attributs of each account

Antoine
Regular Contributor
Regular Contributor

I can see this error in the log 

Exception in RestUtil.getAt : groovy.lang.MissingPropertyException: No such property: #CONST#${String data=response; customproperty9= data for class: java.lang.String

it can be related to my issue

Please share full json


Regards,
Rushikesh Vartak
If you find this response useful, kindly consider selecting 'Accept As Solution' and clicking on the 'Kudos' button.

Antoine
Regular Contributor
Regular Contributor

here is the json

We made some customization because the presence of double quote in the reponse.

 

I can see extensive use of CONST which is causing issue of slowness


Regards,
Rushikesh Vartak
If you find this response useful, kindly consider selecting 'Accept As Solution' and clicking on the 'Kudos' button.

Antoine
Regular Contributor
Regular Contributor

is there some mechanism we can use like user import Preprocessor  for that purpose but for account ?

Regards 

No. Can’t api response changed from app team ?


Regards,
Rushikesh Vartak
If you find this response useful, kindly consider selecting 'Accept As Solution' and clicking on the 'Kudos' button.

Antoine
Regular Contributor
Regular Contributor

I will request for updating the Api

Thanks for your assistance