Databrew Data Quality Queries

0

Planning to use databrew for data validation. I not going to clean the data using Recipe, but just profile and write rule sets and then create a profile job to run on any new datsets. Could you please help me with the below:

  1. can databrew work on streaming data?
  2. can databrew profile job be run concurrently (at same time) on 2 split files(both have same structure)

These are key to determine whether I can use databrew or not. Please advise. Thank you!!

asked 2 years ago273 views
1 Answer
0

Hi,

  1. Data brew does not support streaming data as of today.
  2. You can run a profile job manually for each dataset, not at the same time.
profile pictureAWS
answered 2 years ago
profile pictureAWS
EXPERT
reviewed 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions