Databrew Data Quality Queries

0

Planning to use databrew for data validation. I not going to clean the data using Recipe, but just profile and write rule sets and then create a profile job to run on any new datsets. Could you please help me with the below:

  1. can databrew work on streaming data?
  2. can databrew profile job be run concurrently (at same time) on 2 split files(both have same structure)

These are key to determine whether I can use databrew or not. Please advise. Thank you!!

preguntada hace 2 años281 visualizaciones
1 Respuesta
0

Hi,

  1. Data brew does not support streaming data as of today.
  2. You can run a profile job manually for each dataset, not at the same time.
profile pictureAWS
respondido hace 2 años
profile pictureAWS
EXPERTO
revisado hace 2 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas