s3.fileName does not support folders

[greg-anetac]

Whenever I try submitting a job with a path in "s3.fileName", I get an error like this

{"error":"Bad parameters","status":400,"object":["248 : File name has bad format"]}

Here is sample query request with redacted details:

{
  "query": "[redacted]",
  "from": "5m",
  "to": "now",
  "mode": {
    "type": "json/simple"
  },
  "destination": {
    "type": "s3",
    "params": {
      "aws.bucket": "[redacted]",
      "aws.region": "us-east-2",
      "aws.accesskey": "[redacted]",
      "aws.secretkey": "[redacted]",
      "format": "gzip",
      "s3.fileName":"datadrop/devo_20250131004128"
    }
  }
}

I would expect that forward slashes in S3 file name should be accepted in order to be able to put files into specific folders. Without this, Devo always writes to the root of the bucket, which is a problem.

[franjuan]

Hi @greg-anetac,

By default, the Query API — which is the backend used by the Devo Python SDK — enforces a filename restriction that requires the name to match the following regular expression: ^[\\w\\-. ]+$. As you can see, the / character is not included in the allowed pattern, so filenames containing it are rejected.

We've shared this limitation with our colleagues responsible for the backend, and we hope it will be addressed in the future. However, we can't guarantee a timeline at the moment.

Thanks!