Bring 50k from SF

[daniel-chupak]

Hi,

Has anyone tried to bring about 50k records from SF using the custom action and pagination method?

The issue is that to collect all the data I use the 'Accumulate to list' action and it seems to take too much time which makes me exceed the 90 minutes limit.

I was wondering if anyone has found another solution?

[ajorde]

Processing each record individually is going to greatly increase your task usage in Workato... I still definitely recommend using a mapper action rather than looping through each record individually. I use these in almost every recipe to avoid loops wherever possible.

https://docs.workato.com/recipes/tasks.html

https://docs.workato.com/connectors/mapper.html#mapper-by-workato

https://docs.workato.com/features/common-data-model.html

[sanjay-rathod1]

I had also faced the same type of scenario while used Accumulated List within a Repeat action. One of the solutions is to use the "Search record in Bulk using SOQL query" action to get the exact data that you want. This will return CSV as result. Another possible solution is, try to use "mapper action" or "Create List Variable" rather than accumulated list.