DataBrew: Can you define "Invalid value?"

Question

![Screenshot of DataBrew](/media/postImages/original/IMM0VXqpecRJqELriX9sOGFg)
In the above screenshot, DataBrew has decided that every value in the "state" column was invalid. That's a specific problem, but I'd like the more general answer here; how can I define the rule for a "valid" value? I can do a similar task in the Data Quality rulesets, but I'm not looking to describe how good my data is; I'm trying to replace those invalid values with null.

Answer

I understand that you will like to know the definition of valid and invalid in the context of Databrew.

The validity of a column in Databrew is based on the column type. For instance , if we have a column called HIRE_DATE with column type date:
- Valid in this context refers to the percentage of values with a valid date value
- Invalid refers to the percentage of values with an invalid date value

To replace the invalid values with select 'Invalid' and transformation and replace with desired options presented

DataBrew: Can you define "Invalid value?"

相关内容