MWAA - Sentry Integration

1

Hey,

We had our Airflow system setup with Sentry monitoring before migrating to MWAA, we would like to keep using Sentry for critical errors along with Cloudwatch for usual logs. We added the Sentry requirement to requirements.txt and also added the configurations as in the airflow documentation: sentry.sentry_on=True sentry.sentry_dsn=<OUR_SENTRY_DSN>

When we update our system with these configurations ( we were able to get some alerts from MWAA in Sentry ), but after a while we stop getting them and we get a update failed message ' Update failed' (INCORRECT_CONFIGURATION).

Does anyone have a hint on what's happening? Why we get alerts for a while and then stop getting them and update fails? This should be a quick and simple integration.

Best Regards

asked 2 years ago1194 views
2 Answers
1

MWAA does not currently install requirements on the web server which may be causing the creation failure when the web server tries to communicate with Sentry.

AWS
John_J
answered 2 years ago
  • The referenced docs claim that MWAA v2.2.2+ will install requirements such as Sentry on the web server. Unfortunately we have observed that this issue persists on v2.2.2. When can we expect Sentry configuration to be functional in MWAA?

  • Note the above was true as of Airflow 2.0.2 support. As of Airflow 2.2.2, requirements are installed on the web server. Note that if the libraries are required on a private web server you will need to package them as WHL files

0
Accepted Answer

We confirm Sentry works in MWAA v2.2.2, these are the steps to get it working:

First add Sentry to your requirements.txt file:

apache-airflow[sentry]==2.2.2

Then set in your MWAA Configuration options:

sentry.sentry_on  True
sentry.sentry_dsn  <YOUR_SENTRY_DSN>
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions