cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

SQL Connector

ahanumantharaya
Deputy Chef III
Deputy Chef III

Hi,

I am trying to build a recipe to query large amount of records. Say, 100K Most of the connector ex: Redshift, JDBC, SQL all supports up to 50K records. how do you query remaining records? There is a offset which is not helpful as the Redshift connector doesn't get total number of records as data pill nor other connectors. I can use long running job but it outputs in CSV format which is another problem as numbers column output are represented as in scientific values. Did anyone query 100K  records or more than that?

Thanks,
Amar.

0 REPLIES 0