Missing values For SageMaker Endpoint Invocation Metrics

0

Hi, I've deployed a custom model container as Sagemaker Async Endpoint which works fine so far. It's callable and provides results as expected. I now want to apply a TargetTrackingScalingPolicy but some of the metrics specified here seem to be not reported, they're also not visible in CloudWatch, e.g Invocations and InvocationsPerInstance. On the other hand, metrics like ModelLatency, TotalProcessingTime and TimeInBacklog show reasonable values.

I guess due to these values missing e.g. applying this policy config doesn't have any effect either:

TargetTrackingScalingPolicyConfiguration={
    "TargetValue": 2.0,  # The target value for the metric. - here the metric is - SageMakerVariantInvocationsPerInstance
    "CustomizedMetricSpecification": {
        "MetricName": "InvocationsPerInstance",
        "Namespace": "AWS/SageMaker",
        "Dimensions": [{"Name": "EndpointName", "Value": endpoint_name}],
        "Statistic": "Average",
    },
    "ScaleInCooldown": 60,
    "ScaleOutCooldown": 60
},

Thanks a lot for any advice!

답변 없음

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인