Skip to main content
Question

How do we decide on a safe value for concurrency for Chronicle destination?

  • Mar 11, 2025 3:19 AM UTC
  • 14 replies
  • 110 views

Eugene Katz

How do we decide on a safe value for concurrency for Chronicle destination? We keep seeing a log of these errors. The default value is 5

14 replies

Kam Amir
  • Employee
  • Mar 11, 2025 3:57 AM UTC

Are there any issues with the Chronicle side accepting data from Cribl?


  • Employee
  • Mar 11, 2025 3:57 AM UTC

The data is being eventually accepted. We did increase the concurrency from 5 to 10.


Kam Amir
  • Employee
  • Mar 11, 2025 3:57 AM UTC

ok


Kam Amir
  • Employee
  • Mar 11, 2025 3:57 AM UTC

I was going to ask if you increased the concurrency


  • Employee
  • Mar 11, 2025 3:57 AM UTC

But the bigger problem we are having is that we are pulling this data from an S3 bucket and then pushing to Chronicle. If we run the job as adhoc, data is discovered and collected. If we schedule the same job, the data is discovered and not collected, or the job is cancelled.


Kam Amir
  • Employee
  • Mar 11, 2025 3:57 AM UTC

Does it give you any errors for the scheduled job?


  • Employee
  • Mar 11, 2025 3:58 AM UTC

stack:"HeartbeatMissedTaskError: taskId: collect.14 at v.<anonymous>


Eugene Katz
  • Author
  • Employee
  • Mar 11, 2025 3:58 AM UTC

<@U01BVH0E872&gt; if you have a few min, can we jump into a call. Terry and I have spent quite some time working on this but not able to figure out why scheduled job is not collecting anything


Kam Amir
  • Employee
  • Mar 11, 2025 3:58 AM UTC

Sure


Kam Amir
  • Employee
  • Mar 11, 2025 3:58 AM UTC

can you all jump on the call now?


Eugene Katz
  • Author
  • Employee
  • Mar 11, 2025 3:58 AM UTC

yes


Kam Amir
  • Employee
  • Mar 11, 2025 3:58 AM UTC

i'll pm you the zoom


Eugene Katz
  • Author
  • Employee
  • Mar 11, 2025 3:58 AM UTC

thank you


Kam Amir
  • Employee
  • Mar 11, 2025 3:58 AM UTC

np