Skip to main content
Question

I'm having a hard time get Redis running on my Cribl Workers

  • March 11, 2025
  • 43 replies
  • 32 views

Hi all,I'm having a hard time get Redis running on my Cribl Workers and I don't know what the issue is.What I've done so far:1. Setup a Redis Server in Docker (Standalone)2. Set Up a pipeline as demonstarted in https://docs.cribl.io/stream/redis-function/#scenario-a|Docs3. Setup Redis URL `redis://<password>@&lt;host>:<port>`4. Authentication: None 5. Tested the connection from my cribl worker via `redis-cli` from which I was able to write and retrive Keys from the Redis-ServerBasically, my question is: Why doesn't it work using Cribl?Any ideas on that?Cheers :zebra_face:

43 replies

David Maislin

if your Redis endpoint is encrypted you may need to use rediss (double S)


  • Author
  • Employee
  • March 11, 2025

<@U01AWTNNHQB&gt; you mean:Setup Redis URL `rediss://<password>@&lt;host>:<port>`If so, it is still not working.


David Maislin

Can you share a screenshot of your redis function in Cribl?


  • Author
  • Employee
  • March 11, 2025

Yep, rediss:// is necessary for encrypted endpoints, you can think of it as http(s). We use redis<s://fqdn:port|s://fqdn:port> and add the credentials under Authentication Method as manual.


David Maislin
  1. Is the Redis URL quoted`'redis://<password>@&lt;host>:<port>'`

David Maislin
  1. Is the Key quoted?

David Maislin

Just an example


  • Author
  • Employee
  • March 11, 2025

First Screenshot shows settings, the second one that there is data on the server.Tried both, with quoted and unquoted URL.


David Maislin

I just set and get


Do you have any special characters in the password? Colons, percents, etc?


  • Author
  • Employee
  • March 11, 2025

Still not working...Getting an Error, if I check the logs nothing of interesst appears in there, just the two rows you can see in the screenshot


Basically would this regex fail? `[a-zA-Z0-9_-]+`


  • Author
  • Employee
  • March 11, 2025

<@U01LSBF5953&gt; no special characters. You're regex would catch


Can you share more about this Docker setup? How are you handling exposing the port?


  • Author
  • Employee
  • March 11, 2025

Think that is not the issue, as I retrieve data from the Redis-Server when using the `redis-cli -h <redis-server-ip> -p 6379` command and `get <key>` from cribl worker.Or do you think that still could be an issue?


No, that's a good sign.


  • Author
  • Employee
  • March 11, 2025

Although I couldn't find any information about this, but are there maybe other requirements, such as packages, libraries I need to install on the OS?


Hold on... you can't put your password in the URL like that.


You need to use "Manual" authentication and enter it into the password box.


Like so:


Additionally, do you require a password using the `redis-cli` by specifying the `-a <password>` flag?


If not, I don't think you require any authentication at all.


  • Author
  • Employee
  • March 11, 2025

In regards to the docs, I can set the password in the URL (see screenshot).For `redis-cli` before quering any data I use `AUTH <password>` but I dont need a password in order to execute this one successfully `redis-cli -h <redis-server-ip> -p 6379`


Cool. Try taking the password out of the URL and entering it under Manual auth


  • Author
  • Employee
  • March 11, 2025

Doesn't work either. I tried without an entry in Username and with `default` as the Username