Support is not available at this time so trying this method. We have a job that downloads a file from Hubspot, converts to JSON so that it can be imported into Snowflake. The file is now 30.5MB and we are getting an error using the Ruby Connector. The error is "CSV file is too big. Max allowed: 30 MB, got: 30.5 MB"
The way Hubspot works is that you have to export the entire deals file without a filter so making the file smaller is not an option at this point. We will need to consider a longer term architectural fix so I'm looking to get this working for now.
We are going to convert the Ruby connector to Python Code and will see if that will fix the issue.
Does anyone have any other suggestion in case this does not work?
Ruby Connector code:
est = now + 3.hours
formatted_time = est.strftime('%Y-%m-%d %H:%M')
{out:workato.csv.parse(input["csv"], headers: true).map{|x|x.merge(x){|_,v|v.presence}.merge({snapshot_date: formatted_time})}.to_json}
