Using JQ expression in S3 backup bucket prefix in Backup settings and S3 bucket error output prefix in Amazon S3 destination while configuring Kinesis Firehose delivery stream

1

As of now, while configuring a Kinesis Firehose delivery stream, JQ expressions can be used to determine the S3 bucket prefix in Dynamic Partitioning but they cannot be used to determine the S3 backup bucket prefix in Backup settings and S3 bucket error output prefix in Amazon S3 destination. Being able to use JQ expressions would help me keep the internal structures for partitioned (ORC/Parquet) data, backed up data and errored out data same. Is there any plan to introduce this feature in the near future? If not, it would be great if you could let me know why this feature can't be introduced. Thank you.

pvij
posta 2 anni fa137 visualizzazioni
Nessuna risposta

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande