Community Discussions

Has anyone experienced system metrics crippling the 4200 port? What are some best practices or documentation to combat this and just setting configurations for system metrics in general?

Just upgraded a Stream cluster with 4.03. When performing the Commit to update the workers got "block timeout reached" message. Can be related to the amount of changes (195)? Is there any settings to change the timeout limit for updates?

What's the best way to reference a Worker Group Level Lookup File inside a pack? Would it be: $CRIBL_HOME/groups/<groupname>/data/lookups/LookupFileName.csv ?

I used a standalone test box to get my REST collector working like I wanted.  authentication, discover and collect worked great.  When I moved it into my distributed environment, it errors out but does pull in some events.  The discovery and collect phases are distrubuted across my 5 workers.  It seems like the authentication token may not be working properly when it runs on more than one worker?  I am guessing of course.  I get errors like 503 Service Temporaily Unavailable and 500 Internal Server Error.  This does not happen when I run it from my single standalone test server.  I may need some assistance trying to figure this one out.

I am getting this error in stream when trying to configure an IP address for a TCP source. I can't find any docs around this error.

I am running Edge Nodes on our EC2 instances. When reviewing internal fields from our File Collector sources, I noticed that there is alot of really useful data that our SREs use to investigate which regions & servers are experiencing issues during incidents. These include: - AMI image - Region - Availability Zone - Architecture - Public IP - Private IPI'd like to extract these internal fields as event fields that get sent to our destinations. What is the simplest way to do that?

For other users that have started pulling O365 activity logs using Stream instead of the Splunk app, have you noticed a discrepancy in the event counts? We consistently receive more events through the Splunk app than we do through the Stream source. The setup is exactly the same: tenant, app Id, content, and interval. We've even done comparisons into the data and have found events missing through Stream that were retrieved by the Splunk app. So it seems like Stream is either dropping some events or just not pulling all of them.We do have a case open with Cribl already but I'm wondering if we're the only ones seeing this. Has anyone else noticed compared the volume and noticed the same?

Does Cribl have any documentation for pulling Workday report logs?

Hi All,I am new to Cribl and trying to set notification via webhook for destination have back pressure or destination is unhealthy. But i am getting below error:"the notifications service is not available because a configuration file doesn't exist or the settings are invalid."

We installed the Cribl on our Linux server, and by default, it is user=cribl group=cribl.Our organization requires us to us a Service account to run configuration inside it.Question :Can we change the user and group ownership of the Linux directory of Cribl?And would it affect anything ?From user=cribl group=cribl.To user=svcacc_cribl group=svcacc_cribl

does anyone know how to 'unflatten' fields in Cribl Stream? For example: source.ip is a flattened field that I need to be modified as json: '{ "source": { "ip": "whatever" } }' Original message in Cribl Community Slack Message:https://cribl-community.slack.com/archives/C02A9EQV61J/p1698617495203379

I am currently setting an environmental variable in a Script collector using a JS Expression as follows: TEST_VAR = C.Secret("test1").valueThis works fine for some secrets, but not for others. In the latter case, TEST_VAR is equal to 'C.Secret("test1").value' instead of the actual value.I get the impression that the secrets for which it does not work have not yet been distributed to the workers in the group. Is this correct? Or is there something else wrong here.

With Cribl Stream what is the best practice for receiving windows logs?

I have a field that is nested. I can search with the full name without an issue but when I try to use it with project, I do not get any values back. I have tried to wrap the field with single and double quotes. That results in the value for the field to be the name of the field.The goal is to get a list of all the different values of the payload.comment.commentID field. What do I need to do to use the payload.comment.commentID field? dataset="MyDataSet" sourcetype="MySourceType" payload.comment.commentID=* | project payload.comment.commentID

What is the function of the NSSM.exe process that starts with Cribl Edge?

We're using AWS's c5d instance types which include NVMe instance storage for CRIBL_VOLUME_DIR, but we're also paying for a small EBS volume to host the configs in /opt/cribl.Is there a compelling reason to not just put CRIBL_HOME in the NVMe storage as well and have it pull down the config on startup?I came to this question because I was thinking about a scenario where we might shut down instances during low traffic times and how to handle being sure the CRIBL_VOLUME_DIR on the Ephemeral storage was formatted and mounted. It made me think, "If CRIBL_HOME was also there, then I wouldn't have to worry about CRIBL starting up without CRIBL_VOLUME_DIR being formatted and mounted".

I have an Event with no Splunk Metadata value within the events and i am trying to add new fields such as host, index,source and sourcetype . custom fields and i tried using an eval but no luck, how do i go about this ?

TLDR : JSON Collected from API, parsed through Pipeline, should have three JSON files in S3, but have two where one file have 2 JSON object appended, need help to find out the reasonHi All,At first, I want to say, no this is not an event breaker issue, as much as my understanding. Let me explain.I am trying to get some data from a REST Api endpoint using REST Collector. I am using discovery with Item list, and in the list, there are three values. In preview, three different events are also getting registered (sometimes, sometimes nothing is coming to the preview also).Now I am parsing this response using pipeline and putting the data in a S3 bucket using the router. I followed the documentation to configure the Destination as well as the pipeline and route.Now, I am setting up the schedular to run the REST Collector. Then, after each collection event, when I am checking my s3, there instead of having three separate JSON files for thre

Is the Cribl supporting SNMPv3?

Hi everyone, I have a use case atm where I have a lookup that contains a column of "allowed fields" for various sourcetypes, that is, the value for a given sourcetype is a common separted list of field names. At the end of my pipeline, I basically want to import this field list and throw away all fields in the data that are not contained in the list (because I'm finished with the normalization). Is there an easy way to do this? The serialize function has essentially the same functionality, when you import the parser you get a keep fields list. But how to do this without the parser? Original message in Cribl Community Slack Message: https://cribl-community.slack.com/archives/CPYBPK65V/p1682331204917309

Why is my Splunk destination showing unhealthy when the individual workers are showing a green healthy status?

How do I change a worker's temp directory from "/tmp"?

I am trying to add a new Edge node to my Cribl Cloud instance. I click on the Add/Update Edge Node and get the script. The docker instance installs but when it goes to run the Edge instance, it errors out.Server:Ubuntu 22.04.3 LTS (GNU/Linux 5.2.0 x86_64)Install:docker run -d --privileged -e "CRIBL_DIST_MASTER_URL=tls://{token}@{instance}.cribl.cloud:4200?group=default_fleet" -e "CRIBL_DIST_MODE=managed-edge" -e "CRIBL_EDGE=1" -p 9420:9420 -v "/:/hostfs:ro" --restart unless-stopped --name "cribl-edge" cribl/cribl:latestUnable to find image 'cribl/cribl:latest' locallylatest: Pulling from cribl/cribledaedc954fb5: Pull completef83a34600de3: Pull complete94a7ecdae25d: Pull complete995bcc02c181: Pull completeb0adc0627ec2: Pull completeDigest: sha256:8879de72b7cd95715e938d7828dd6adb0e5869fe893cfe1612cd520e0746bf46Status: Downloaded ne

When I use a parser function to parse my json _raw field, I see that my original data changes and it breaks my dashboards:Why does it change?

How to connect my Bitbucket repository with Cribl?Question: When trying to push to a remote git repository created in Bitbucket under a project, I am getting the following error:This is working for other repositories created under a specific user, but not under a project in bitbucket.