Pipeline is working well until RepackModel..AlgorithmError: framework error: Traceback (most recent call last): File "/miniconda3/lib/python3.7/site-packages/sagemaker_containers/_trainer.py", line 84

0

ClientError: AlgorithmError: framework error: Traceback (most recent call last): File "/miniconda3/lib/python3.7/site-packages/sagemaker_containers/_trainer.py", line 84, in train entrypoint() File "/miniconda3/lib/python3.7/site-packages/sagemaker_sklearn_container/training.py", line 39, in main train(environment.Environment()) File "/miniconda3/lib/python3.7/site-packages/sagemaker_sklearn_container/training.py", line 35, in train runner_type=runner.ProcessRunnerType) File "/miniconda3/lib/python3.7/site-packages/sagemaker_training/entry_point.py", line 100, in run wait, capture_error File "/miniconda3/lib/python3.7/site-packages/sagemaker_training/process.py", line 291, in run cwd=environment.code_dir, File "/miniconda3/lib/python3.7/site-packages/sagemaker_training/process.py", line 208, in check_error info=extra_info, sagemaker_training.errors.ExecuteUserScriptError: ExecuteUserScriptError: ExitCode 1 ErrorMessage "" Command "/bin/sh -c ./_repack_script_launcher.sh --dependencies

ClientError: AlgorithmError: framework error: Traceback (most recent call last): File "/miniconda3/lib/python3.7/site-packages/sagemaker_containers/_trainer.py", line 84, in train entrypoint() File "/miniconda3/lib/python3.7/site-packages/sagemaker_sklearn_container/training.py", line 39, in main train(environment.Environment()) File "/miniconda3/lib/python3.7/site-packages/sagemaker_sklearn_container/training.py", line 35, in train runner_type=runner.ProcessRunnerType) File "/miniconda3/lib/python3.7/site-packages/sagemaker_training/entry_point.py", line 100, in run wait, capture_error File "/miniconda3/lib/python3.7/site-packages/sagemaker_training/process.py", line 291, in run cwd=environment.code_dir, File "/miniconda3/lib/python3.7/site-packages/sagemaker_training/process.py", line 208, in check_error info=extra_info, sagemaker_training.errors.ExecuteUserScriptError: ExecuteUserScriptError: ExitCode 1 ErrorMessage "" Command "/bin/sh -c ./_repack_script_launcher.sh --dependencies

JasonP
preguntada hace un mes136 visualizaciones
2 Respuestas
1

🤔 You may need to investigate the code and configuration of the RepackModel step in your pipeline, as well as the dependencies and dependencies of the user script that is being executed. You may also need to check the input data and model parameters to ensure that they are correct and compatible with the algorithm and framework being used.

profile picture
EXPERTO
respondido hace un mes
  • where can i find the script? the register-RepackModel is automatically created in the pipeline by sagemaker after check-model-accuracy?

  • From the error logs you've provided, the system is unable to find the _repack_script_launcher.sh script, which should be a part of the SageMaker training job. There's also an error indicating that the file model.tar.gz cannot be found in the expected directory, and there's a failure to parse a hyperparameter.

  • The model.tar.gz file is not found in the directory /opt/ml/input/data/training/. Try to check that the file is being generated correctly and is being placed in the correct directory.

  • Which OS are you using for your Sagemaker? Make sure you are using a supported OS

1

Here's the additional error I've checked on the sagemaker studio logs:

Enter image description here

Enter image description here

Enter image description here

Enter image description here

JasonP
respondido hace un mes

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas