topic Re: accessing json contents without a schema in Workato Pros Discussion Board

accessing json contents without a schema

rm135 — Tue, 08 Jul 2025 01:59:28 GMT

Hi,

I'm retreiving sign in logs from MS graph via HTTP. The schema is complex and seems to change a lot so I've had issues trying to define a proper schema for data pills.

I would really just like to access one of the high level json objects and be able to use it as data I would save to a file or pass to a snowflake field.

e.g. in python I would just use

response.json()['value']

is this possible?

Re: accessing json contents without a schema

gary1 — Tue, 08 Jul 2025 03:45:09 GMT

Add the payload data pill to a logger or variable or wherever, set it to formula mode, and do response["value"]

If your "response" data pill looks like this:

{ "test1": "one", "test2": "two", "test3": [ 1, 2, 3 ], "test4": [ {"test5": "five"} ], "test6": { "test7": "seven" } }

Then this follows:

response["test1"] => "one"
response["test3"][0] => 1
response["test4"][0]["test5"] => "five"
response["test6"]["test7"] => "seven"

And so on...

Re: accessing json contents without a schema

Bhagya_pola — Tue, 08 Jul 2025 04:03:17 GMT

Hello, @rm135 ,

you can do that by keeping the response format as TEXT in your HTTP step. That way, you don't need to define any schema or worry about data pills.

But since the response will be treated as a raw JSON string, you'll need to use a code step (Ruby, Python, or JavaScript) to parse that string and extract the part you need

Hope this helps! Let me know if I missed your question or if you need something different.

Re: accessing json contents without a schema

platovandre — Sun, 13 Jul 2025 02:34:56 GMT

I would use the part of the schema that is stable, Workato is pretty forgiving in terms of the Json 👌.

You can

pass a larger object (with more fields) than what was defined in the initial schema just fine.
Just make sure you define the parts/fields you need for your recipe in the schema, and just ignore anything that might be changing.

By doing that you get the data pills for the fields that are set/standard across the logs. You can then run whatever logic you want with that. ✅

You will not get data pills for the parts you took out of the schema (or anything new that shows up), which is fine since you will be passing the log elsewhere. In case you only need to pass a part of the JSON - that can be done just like @gary1 suggested with formula mode to extract what you need and passing that through.

That said, I would avoid trying to manually parse the JSON as a text ⛔ - you loose the benefits of the data pills and create tech debt. It also takes more time to setup and maintain. So, avoid these headaches and use the standard schema that you need (not the whole schema). Only pars/extract things if you have a specific requirement/need to pass part of the log.

Let me know how it goes.

Cheers!

Re: accessing json contents without a schema

Bhagya_pola — Sun, 13 Jul 2025 09:53:37 GMT

Hello @platovandre

Thanks for the input. That said, in scenarios where the schema is unstable or frequently changing, working with the raw JSON as text and handling it in a code step (Python/JS) is actually much more flexible — not really a headache if you're comfortable with basic scripting.

Also, regarding data pills — if needed, we can define a custom output schema in the code step’s output fields, so pill generation can be fully controlled without relying on upstream schema stability.

This approach gives more control and avoids unnecessary complications when the structure isn’t consistent.

Re: accessing json contents without a schema

rajeshjanapati — Mon, 14 Jul 2025 07:07:06 GMT

Hi @rm135,

After reviewing your issue, I’d recommend using a Python script step to extract the specific object from the response — particularly when the response schema is dynamic or frequently changing.

For instance, you can extract the array using, when it is structured json only:

response.json()['value']

Once you've extracted the required portion of the JSON (like the value array), you can pass the output of the Python script to a Parse JSON step. From there, you’ll be able to map the fields easily to the Snowflake step.

Using formulas to handle dynamic structures can become complex and error-prone. In such scenarios, a Python script provides better flexibility and control over dynamic JSON structures.

Re: accessing json contents without a schema

Obugari — Mon, 04 Aug 2025 15:28:53 GMT

Hi @rm135
In HTTP call at response you can define the output schema (it generate each field) . At next step you can use the datapills to map snowflake.
Second Approach - You can use Parse Json step . so it generated data pills

Thankyou