By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Why Metric do not shown in TrainingJobs

0

I follow the tutorial and set metrics defintion in a TrainingJob. But, when train completed, The training job dashboard cannot show the loss/acc curve. Enter image description here

After I check cloudwatch, the upper blue one is query generated by TraingJobs that can not shown any data, But The orange one selected directly from CloudWath Page is worked.

so I think my metrics setting let cloudwatch catch metrics data properly. but somethings happend in the inter-communication settings between cloudWatch and TrainingJob. Is there anyone face this problem before ? Enter image description here

Topics
Machine Learning & AIManagement & Governance
Tags
Machine Learning & AIAmazon CloudWatchAmazon SageMaker Model Training
Language
English
vela
asked 10 months ago210 views
1 Answer
0

I suspect it could be due to a tamper money script on your end and also requesting you to clear the browser cache and try different browsers and see if you are still facing the issue.Also requesting you to run other sample training jobs on your end and see if you are facing the same issue

AWS
Wael_AWS
answered 10 months ago
  • vela
    10 months ago

    I tried to clear cache of browser, but it still can not show the Logs. I Just wonder why the dashborads logs from HOST, Like CPU,GPU works but logs from Trainingjob with Region Failed ....

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content