Planning to use databrew for data validation. I not going to clean the data using Recipe, but just profile and write rule sets and then create a profile job to run on any new datsets. Could you please help me with the below: 1) can databrew work on streaming data? 2) can databrew profile job be run concurrently (at same time) on 2 split files(both have same structure) These are key to determine whether I can use databrew or not. Please advise. Thank you!!

Hi, 1. Data brew does not support streaming data as of today. 2. You can run a profile job manually for each dataset, not at the same time.

Databrew Data Quality Queries

Planning to use databrew for data validation. I not going to clean the data using Recipe, but just profile and write rule sets and then create a profile job to run on any new datsets. Could you please help me with the below:

can databrew work on streaming data?
can databrew profile job be run concurrently (at same time) on 2 split files(both have same structure)

These are key to determine whether I can use databrew or not. Please advise. Thank you!!

Argomenti

Analisi

Tag

AWS Glue DataBrew

Lingua

English

AWS-User-6839064

posta 2 anni fa280 visualizzazioni

1 Risposta

Più recenti
Maggior numero di voti
Maggior numero di commenti

Queste risposte sono utili? Dai un voto positivo alla risposta corretta per aiutare la community a trarre vantaggio dalle tue conoscenze.

Hi,

Data brew does not support streaming data as of today.
You can run a profile job manually for each dataset, not at the same time.

CHELSEA IP

con risposta 2 anni fa

ESPERTO

Julia Beck

verificato 2 anni fa

Contenuto pertinente

Come faccio a correggere l'errore "Unable to validate the following destination configurations" in AWS CloudFormation?
AWS UFFICIALEAggiornata 2 anni fa
Come posso risolvere l'errore di CloudFormation "Unable to assume role and validate" quando avvio una risorsa Amazon ECS?
AWS UFFICIALEAggiornata 3 mesi fa
Come posso risolvere gli errori "could not send data to client" o "could not receive data from client" quando mi collego alla mia istanza database Amazon RDS per PostgreSQL o Aurora compatibile con PostgreSQL?
AWS UFFICIALEAggiornata 10 mesi fa
Come posso risolvere l'errore "javaSQLSQLException: No more data to read from socket (Nessun dato di lettura rimanente dal socket)" quando provo a connettermi alla mia istanza Amazon RDS for Oracle?
AWS UFFICIALEAggiornata 2 anni fa