CloudWatch Metrics
You can use the built-in Amazon SageMaker Model Monitor container for CloudWatch metrics. When the
emit_metrics option is Enabled in the baseline
constraints file, SageMaker AI emits these metrics for each feature/column observed in the
dataset in the following namespace:
-
For real-time endpoints: /aws/sagemaker/Endpoints/data-metricnamespace withEndpointNameandScheduleNamedimensions. -
For batch transform jobs: /aws/sagemaker/ModelMonitoring/data-metricnamespace withMonitoringScheduledimension.
For numerical fields, the built-in container emits the following CloudWatch metrics:
-
Metric: Max → query for
MetricName: feature_data_{feature_name}, Stat: Max -
Metric: Min → query for
MetricName: feature_data_{feature_name}, Stat: Min -
Metric: Sum → query for
MetricName: feature_data_{feature_name}, Stat: Sum -
Metric: SampleCount → query for
MetricName: feature_data_{feature_name}, Stat: SampleCount -
Metric: Average → query for
MetricName: feature_data_{feature_name}, Stat: Average
For both numerical and string fields, the built-in container emits the following CloudWatch metrics:
-
Metric: Completeness → query for
MetricName: feature_non_null_{feature_name}, Stat: Sum -
Metric: Baseline Drift → query for
MetricName: feature_baseline_drift_{feature_name}, Stat: Sum