07-31-2024 07:28 AM
Hi all - Just curious if anyone has encountered data size limits when passing data from a recipe to a recipe function? Or if anyone knows if a limit is documented?
For context, I'm passing text file contents downloaded from an SFTP server from a recipe to a recipe function in one of the input parameters. I need to make sure that the entire file is included when the recipe function is called.
Any thoughts or insights would be greatly appreciated!
Per aspera ad astra.
07-31-2024 09:39 AM
I don't know if there's a specific limit, but I've definitely run into dispatch errors on both recipes and actions when handling large data. If you need to move a file between recipes, I recommend uploading it somewhere (Workato files, AWS S3, Box, etc.) and passing the URL as input.
08-01-2024 09:32 PM - edited 08-01-2024 09:32 PM
Agree with @gary1 on stashing the file elsewhere and passing the reference, Though I got annoyed doing that in some cases bc then I'm pulling the file from a file repository only to stash it in another repository to pull from later.
I did inquire into this question with Workato support in the past b/c of similar needs, and I was told 50 MB is the request limit to be passed around. So if you're smaller then that you should be ok, but if there's a chance it'll scale beyond that then you may want to look into offloading it.
08-04-2024 04:55 PM