DataBrew: Can you define "Invalid value?"

0

Screenshot of DataBrew In the above screenshot, DataBrew has decided that every value in the "state" column was invalid. That's a specific problem, but I'd like the more general answer here; how can I define the rule for a "valid" value? I can do a similar task in the Data Quality rulesets, but I'm not looking to describe how good my data is; I'm trying to replace those invalid values with null.

preguntada hace un año286 visualizaciones
1 Respuesta
0

I understand that you will like to know the definition of valid and invalid in the context of Databrew.

The validity of a column in Databrew is based on the column type. For instance , if we have a column called HIRE_DATE with column type date:

  • Valid in this context refers to the percentage of values with a valid date value
  • Invalid refers to the percentage of values with an invalid date value

To replace the invalid values with select 'Invalid' and transformation and replace with desired options presented

AWS
Sahil_S
respondido hace un año
  • This does not explain why DataBrew decided my entire column should be null, nor does it really answer the question in any way.

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas