topic Re: CSV file includes quotes in Workato Pros Discussion Board

CSV file includes quotes

klandry — Thu, 27 Jun 2024 18:58:52 GMT

I am creating CSV files (technically TAB delimited) using Compose CSV. I am using a List for the source.
I have the option to Force Quotes Set to NO, yet for any fields where I am not supplying a value (as they are not required), double quotes are being inserted.

This does not seem to be correct to me as I should be able to have no values between delimiters without Quotes.
eg: 1 000[TAB]102095[TAB][TAB]DP[TAB][TAB]March

Instead, I am getting this:
1000[TAB]102095[TAB]""[TAB]DP[TAB]""[TAB]March

Re: CSV file includes quotes

gary1 — Thu, 27 Jun 2024 21:59:35 GMT

I'm seeing the same behavior and I can only assume it's intentional. Is it causing an issue elsewhere in your recipe or workflow?

Re: CSV file includes quotes

klandry — Fri, 28 Jun 2024 00:26:20 GMT

I don’t understand the logic behind it. Firstly, there is the force quote option, which I have turned off. I can understand encapsulating data in quotes when a delimiting character is found in the data — like a comma character when using CSV format, but I am using TAB. The whole reason for tab delimited format is because TABs are seldom if ever found as part of the data.

In any case, these are empty values. It is not practical for me to supply values for these columns, as they are optional and receive default values once in imported into the destination system.

I spent hours today looking for a workaround, but the Composer CSV connector inserts quotes when it encounters NIL or empty strings. The destination system requires TAB delimited format.

Re: CSV file includes quotes

shivakumara — Fri, 28 Jun 2024 11:29:56 GMT

Hi @klandry ,

We have found a solution to the problem you are having. The problem comes from the array values you pass to create the CSV.
1. If the field value is empty, ""(double Quote) problem occurs because the empty value is called "" (double quotes).
In this case, we operate differently at the source or target level.

Example: 1000 NoValue 102095 NoValue DP

In this case you can use Value.present?? Value: skip

Here is an example of a recipe screenshot. Please check it out and let me know if you need help..

Re: CSV file includes quotes

klandry — Fri, 28 Jun 2024 12:03:00 GMT

Thanks very much for that solution. This will work for me.
You've saved me from pulling the rest of my hair out.
🙂

Re: CSV file includes quotes

shivakumara — Fri, 28 Jun 2024 13:33:35 GMT

Thank you for the confirmation @klandry and have a good day.