DataBrew: Can you define "Invalid value?"

0

Screenshot of DataBrew In the above screenshot, DataBrew has decided that every value in the "state" column was invalid. That's a specific problem, but I'd like the more general answer here; how can I define the rule for a "valid" value? I can do a similar task in the Data Quality rulesets, but I'm not looking to describe how good my data is; I'm trying to replace those invalid values with null.

asked a year ago278 views
1 Answer
0

I understand that you will like to know the definition of valid and invalid in the context of Databrew.

The validity of a column in Databrew is based on the column type. For instance , if we have a column called HIRE_DATE with column type date:

  • Valid in this context refers to the percentage of values with a valid date value
  • Invalid refers to the percentage of values with an invalid date value

To replace the invalid values with select 'Invalid' and transformation and replace with desired options presented

AWS
Sahil_S
answered a year ago
  • This does not explain why DataBrew decided my entire column should be null, nor does it really answer the question in any way.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions