By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

How to stop a EMR Notebook execution after a error in a cell

0

Hi there,

Do you know how to stop a notebook on cell error?

It seems that the normal behavior is to continue on error, but I want to stop execution after the first error or fail,

Maybe a notebook flag, or editor flag?

We are using emr run notebook api, and we think that one year before it used to stop on error cell but not anymore.

Thanks

Topics
Analytics
Tags
Amazon EMR
Language
English
rmis
asked a year ago194 views
1 Answer
0

Hello,

Thanks for writing on re:Post

The functionality you have explained here is available when using the PySpark Kernel within a Jupyter Notebook.

When raising an error within a cell, if that error is flagged in the run time, the notebook will not continue to run the following cells even when using the Run All Option.

When an error is met, the notebook will output the information of this error and will stop executing.

I hope the above information helped in addressing your concern

Thanks

AWS
SUPPORT ENGINEER
Mudasser_A
answered a year ago
  • rmis
    a year ago

    Thanks! You're right, we don't have any problem with python3 kernel, just with pyspark.

    How do you flag them in runtime? Can you do that from emr start emr notebook api or step function start emr notebook execution?

    We raise exceptions inside cells and doesn't stop notebook executions,

    Thanks

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content