โ04-16-2021 03:14 AM
What are folks using to back up their workato job history? We aren't currently backing up our job history, but need to start doing so. I would imagine tools Datadog, Snowflake, etc would be good for this. What's everyone using? Do you like it? Let me know!
โ04-16-2021 03:50 AM
Hi Joe, you can use the log streaming feature to backup the job history to external source like S3 or any other log service provider like Datadog, Splunk, Sumologic etc. The log streaming feature supports any cloud based logging service that has an HTTP based ingestion endpoint. Here in this example I've configured job history and user activity to stream to Datadog.
โ04-16-2021 05:11 AM
Thanks Deven! I'm aware of the event streaming feature, just curious where folks are streaming to. I thought Datadog might be a popular option.
โ04-16-2021 08:27 AM
Hi, Joe!
There is also an alternative way for this, such as putting the assembled log payload to DWH. It can be done using callable recipe from any recipe you want with the payload you want to put in it and table name as parameters.
This seems more complicated way but if you already have a DWH, you don't need other tools for this
โ04-16-2021 12:59 PM
Hey Joe, we use Splunk! its amazing and have setup alerts and dashboards too using built-in Splunk feature offered. Its easy setup and intutive too!