Skip to main content
Question

Where do I find the backpressure graphs?

  • March 11, 2025
  • 44 replies
  • 74 views

Where do I find the backpressure graphs? I normally stumble-into them but not having luck this am....

44 replies

This can be seen in the destination's 'charts' tab, the bottom chart, blocked status chart will show a redline (value 1) when back pressuring.


  • Author
  • Known Participant
  • March 11, 2025

<@UUP82DJHE&gt;Is this for Stream?


  • Author
  • Known Participant
  • March 11, 2025

I'm asking about Stream.


yes


  • Author
  • Known Participant
  • March 11, 2025

Can you please give me the menu options you're using to get to it? I don't see this.


Managed -> Data -> Destinations -> <The Destination to check> -> Charts


Also u can see this in Monitoring -> Data -> Destinations as seen here.


  • Author
  • Known Participant
  • March 11, 2025

Got it


Here's an better example of a destination back pressuring for: Managed -> Data -> Destinations -> <The Destination to check> -> Charts


  • Author
  • Known Participant
  • March 11, 2025

It appears we're not experiencing backpressure:


  • Author
  • Known Participant
  • March 11, 2025

Must be another problem.


Just curious, is there an error on the status screen and or logs?


  • Author
  • Known Participant
  • March 11, 2025

Doesn't look like it. However we're getting several errors for our Cribl Collectors that are trying to pull Okta logs.


  • Author
  • Known Participant
  • March 11, 2025

message:Error reading stats file for job: http://1677098100.249.scheduled.in|1677098100.249.scheduled.in_REST_ProofPoint_TAPmessage:Error reading stats file for job: http://1677098100.250.scheduled.in|1677098100.250.scheduled.in_REST_Okta_Prod_External


  • Author
  • Known Participant
  • March 11, 2025

Actually, I think all of our Cribl Collectors are being impacted right now.


Sorry, I should of specified more clearly. The screenshot above from from a Google Chronicle Destination. Are there errors being report for that destination (in the logs tab) that lead you to believe there is back pressure?


  • Author
  • Known Participant
  • March 11, 2025

Just that "Backpressure" has been a common symptom when we experience receiving several email notifications for Cortex Data Lake disconnect notifications.


  • Author
  • Known Participant
  • March 11, 2025

There doesn't appear to be errors for the Cribl_to_Chronicle Destination:


  • Author
  • Known Participant
  • March 11, 2025

Lots of errors for our Collectors:


If u expand on of the API errors, there should be additional information, like http code and reason that will provide more insight


  • Author
  • Known Participant
  • March 11, 2025

{ "time": "2023-03-23T18:07:54.507Z", "cid": "api", "channel": "rest:jobs", "level": "error", "message": "API Error", "error": { "message": "Failed to find job with id=in_REST_ProofPoint_TAP", "stack": "RESTError: Failed to find job with id=in_REST_ProofPoint_TAP
at L._get (/opt/cribl/bin/cribl.js:14:20679999)" }, "url": "/jobs/in_REST_ProofPoint_TAP"}


  • Author
  • Known Participant
  • March 11, 2025

They all appear to be like that, except the errors are for each REST Collector we have set-up.


~By chance is the file system full? TBH I've never seen this error.~


Take that back, this is a case of a job artifact being deleted from the UI but the artifact has already been deleted... so it's an error but not related to the job running successfully or not. I'd check on status of these collector runs in Monitoring -> System -> Job Inspector -> Scheduled


  • Author
  • Known Participant
  • March 11, 2025

<@UUP82DJHE&gt;For "All Groups":