Unable to run a Python script using BashOperator

Question

I need to run a Python script using BashOperator. I placed the script in dags folder of the S3 bucket and ran my DAG with BashOperator. It's throwing the error: **python3: can't open file 'hello_world.py': No such file or directory**  
  
Also, I noticed that the Airflow worker runs the command in a temporary script location: say, /tmp/airflowtmpx03mq_qp/run_scriptlolkuw_q. Also this path changes on every DAG run. How can run the script in this scenario? Please help me with the easiest approach possible on Managed Airflow. Thanks  
  
Edited by: ArjunAnaji on May 17, 2021 9:13 AM

Accepted Answer

Hi!  
  
Anything placed in the S3 folder containing your DAGs will be synced to /usr/local/airflow/dags on the MWAA worker.  So, to run a file called "hello_world.py" you would use the bash command "python3 /usr/local/airflow/dags/hello_world.py"  
  
Thanks!

Unable to run a Python script using BashOperator

相關內容