Hi,
I am trying to build a recipe to query large amount of records. Say, 100K Most of the connector ex: Redshift, JDBC, SQL all supports up to 50K records. how do you query remaining records? There is a offset which is not helpful as the Redshift connector doesn't get total number of records as data pill nor other connectors. I can use long running job but it outputs in CSV format which is another problem as numbers column output are represented as in scientific values. Did anyone query 100K records or more than that?
Thanks,
Amar.
