topic Re: Data Limit of Input Parameters between Recipe and Recipe Function? in Workato Pros Discussion Board

Data Limit of Input Parameters between Recipe and Recipe Function?

alarochelle — Wed, 31 Jul 2024 14:28:07 GMT

Hi all - Just curious if anyone has encountered data size limits when passing data from a recipe to a recipe function? Or if anyone knows if a limit is documented?

For context, I'm passing text file contents downloaded from an SFTP server from a recipe to a recipe function in one of the input parameters. I need to make sure that the entire file is included when the recipe function is called.

Any thoughts or insights would be greatly appreciated!

Per aspera ad astra.

Re: Data Limit of Input Parameters between Recipe and Recipe Function?

gary1 — Wed, 31 Jul 2024 16:39:31 GMT

I don't know if there's a specific limit, but I've definitely run into dispatch errors on both recipes and actions when handling large data. If you need to move a file between recipes, I recommend uploading it somewhere (Workato files, AWS S3, Box, etc.) and passing the URL as input.

Re: Data Limit of Input Parameters between Recipe and Recipe Function?

mppowe — Fri, 02 Aug 2024 04:32:43 GMT

Agree with @gary1 on stashing the file elsewhere and passing the reference, Though I got annoyed doing that in some cases bc then I'm pulling the file from a file repository only to stash it in another repository to pull from later.

I did inquire into this question with Workato support in the past b/c of similar needs, and I was told 50 MB is the request limit to be passed around. So if you're smaller then that you should be ok, but if there's a chance it'll scale beyond that then you may want to look into offloading it.

Re: Data Limit of Input Parameters between Recipe and Recipe Function?

alarochelle — Sun, 04 Aug 2024 23:55:52 GMT

@gary1 @gary1 The approach makes sense. Files shouldn't exceed 50 MB but we're storing them someplace anyway. Rearranged my steps a bit. Much appreciated!