Why Metric do not shown in TrainingJobs
I follow the tutorial and set metrics defintion in a TrainingJob.
But, when train completed, The training job dashboard cannot show the loss/acc curve.
After I check cloudwatch, the upper blue one is query generated by TraingJobs that can not shown any data, But The orange one selected directly from CloudWath Page is worked.
so I think my metrics setting let cloudwatch catch metrics data properly. but somethings happend in the inter-communication settings between cloudWatch and TrainingJob. Is there anyone face this problem before ?
- 新しい順
- 投票が多い順
- コメントが多い順
I suspect it could be due to a tamper money script on your end and also requesting you to clear the browser cache and try different browsers and see if you are still facing the issue.Also requesting you to run other sample training jobs on your end and see if you are facing the same issue
I tried to clear cache of browser, but it still can not show the Logs. I Just wonder why the dashborads logs from HOST, Like CPU,GPU works but logs from Trainingjob with Region Failed ....