By using AWS re:Post, you agree to the Terms of Use

Databrew Data Quality Queries

0

Planning to use databrew for data validation. I not going to clean the data using Recipe, but just profile and write rule sets and then create a profile job to run on any new datsets. Could you please help me with the below:

  1. can databrew work on streaming data?
  2. can databrew profile job be run concurrently (at same time) on 2 split files(both have same structure)

These are key to determine whether I can use databrew or not. Please advise. Thank you!!

asked a month ago22 views
1 Answers
0

Hi,

  1. Data brew does not support streaming data as of today.
  2. You can run a profile job manually for each dataset, not at the same time.
profile picture
answered 10 days ago
profile picture
EXPERT
reviewed 8 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions