How to execute parallel dags in Airflow in EC2 Instance

0

I have Installed Airflow as a service in EC2 Instance. It is working fine with Sequential execution. But While I am trying with Parallel execution I am facing Issues. It is not running parallel dags execution. I have installed PostgreSQL inside EC2 instance.

Step1: I have installed Airflow. Step2: Installed the Postgresql Step3: In airflow.cfg, modified to sequential Executor to Local Executor. Step4: Restarted the Airflow and scheduler.

1回答
0

If you want parallel dags to run in EC2, you need to use another executor. Sequential executor will only allow single dag to run. You can use celery executor which is used for production level tasks. You can use Local executor also if you are just testing things out.

回答済み 1ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ