TLDR : JSON Collected from API, parsed through Pipeline, should have three JSON files in S3, but have two where one file have 2 JSON object appended, need help to find out the reason

Hi All,

At first, I want to say, no this is not an event breaker issue, as much as my understanding. Let me explain.

I am trying to get some data from a REST Api endpoint using REST Collector. I am using discovery with Item list, and in the list, there are three values.

In preview, three different events are also getting registered (sometimes, sometimes nothing is coming to the preview also).

Now I am parsing this response using pipeline and putting the data in a S3 bucket using the router. I followed the documentation to configure the Destination as well as the pipeline and route.

Now, I am setting up the schedular to run the REST Collector. Then, after each collection event, when I am checking my s3, there instead of having three separate JSON files for three separate events, there are two JSON files, one with 1 JSON Object, another one with TWO Json object appended one after another (appended, not comma separated or anything). Can anyone tell me why it might be happening and how to mitigate it?

PS. I used the system default event breaker, as well as Cribl no break Event breaker ruleset with same Issue.