Can you create a custom DataBrew operation?

0

We have some business logic we would like to implement in DataBrew, that would be difficult to do using the existing predefined operations. Is it possible to add a custom build operation to do this in one action?

Phil
질문됨 9달 전347회 조회
1개 답변
0
수락된 답변

AWS DataBrew is a visual data preparation tool that allows users to clean and normalize data without writing code. It offers a set of predefined transformations that you can apply to your data. However, there are some limitations:

Custom Operations: DataBrew does not natively support creating custom operations or transformations. You are limited to the predefined operations available within the service.

Workarounds: If a specific transformation is not available in DataBrew, you might need to:

  • Use multiple existing transformations in sequence to achieve the desired result.
  • Pre-process or post-process the data using another service or tool (like AWS Lambda, AWS Glue, or even local scripts) before or after using DataBrew.

Integration with Other AWS Services: If you have complex business logic that cannot be achieved with DataBrew's predefined operations, consider using AWS Glue. AWS Glue is a fully managed extract, transform, and load (ETL) service that allows you to easily prepare and load your data for analytics. With Glue, you can write custom Python or Scala scripts to transform your data.

In summary, while AWS DataBrew is a powerful tool for data preparation with a wide range of predefined operations, it does not support custom operations. For complex transformations, you might need to rely on other AWS services or tools.

profile picture
답변함 9달 전
profile pictureAWS
전문가
검토됨 9달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠