Skip to main content
Solved

Can Cribl Stream read AWS S3 tags?

  • March 11, 2025
  • 5 replies
  • 16 views
A

Can Cribl Stream read AWS S3 tags? I know there are multiple places where you can add tags to parts of the stream, such as in the Source or in a Pipeline, but I want my stream to be able to read the tags that are assigned via S3 in order to filter them. If that's not possible, would I be able to call a Lambda function and use that to manage the tags instead?

Best answer by Brendan Dalpe

@Aaron Hornbuckle I don't think we're going to be able to read S3 tags today. You'll either need to use a Lambda to enrich them before sending to Cribl, or we'll need to look at adding something to support this.

    5 replies

    T
    • Tony R
    • Employee
    • March 11, 2025

    Looking at the documentation for S3, in the optional settings, it references tags.

    https://docs.cribl.io/stream/sources-s3/#optionalsettings

    A

    Thank you for your reply, Tony! Just to clarify, I did see that in the documentation. I just wanted to verify that that tagging feature enables reading of tags preexisting on data coming in from the source, and not just adding a new tag to the data. IE I add tags to data in S3 and then that tagging feature in Cribl allows me to read/filter/group.

    B

    @Tony Reinke - Cribl those "tags" in Cribl are for organization of config items in the UI and won't work for this use case.

    B
    • Brendan Dalpe
    • Inspiring
    • Answer
    • March 11, 2025

    @Aaron Hornbuckle I don't think we're going to be able to read S3 tags today. You'll either need to use a Lambda to enrich them before sending to Cribl, or we'll need to look at adding something to support this.

    T
    • Tony R
    • Employee
    • March 11, 2025

    Thanks @Brendan Dalpe !

    Terms & ConditionsAccessibility statement