Hi, I am currently exploring a way to collect event data and looking to save it into a temporary staging storage (GCS Bucket) before transferring the data downstream for further processing.

I am having difficulty to get a working configuration on Stream no matter what I tried. Stream worker is always throwing the following error: "failed to close file" where the detailed message is saying "Invalid argument." without much details except that the file that Stream worker is having issue to close is at this location: /opt/cribl/state/outputs/staging/prefix/Bucket_yyyymmdd_hhmm/yyyy/mm/dd/CriblOut-<random>.0.json.tmp

I have checked that the credentials for accessing the bucket is valid and the permissions for the given credentials are alright for upload files into the bucket.

Does anyone have any idea how I might be able to get around this problem?

Thanks.