Ref: https://www.udemy.com/course/aws-ai-practitioner-certified/learn/lecture/44887783

• Contents:

Model Cards

• 🔧 Essential model information
  • Example: intended uses, risk ratings, and training details
• Screenshot

Role Manager

• 🔧 Define roles for personas
  • Example: data scientists, MLOps engineers
  • For permissions and access control

Model Dashboard

• 🔧 Centralized repository/portal
  • Information and insights for all models
  • Example: track which models are deployed for inference
• Accessible from SageMaker console
• Helps you find models that violate thresholds you set for data quality, model quality, bias, explainability…
• Screenshot

Model Monitor

• 🔧 Monitor the quality of your model in production
  • Continuous or on-schedule monitoring
  • Alerts for deviations (drifts) in the model quality → fix data & retrain model
  • Example: loan model starts giving loans to people who don’t have the correct credit score (drift)
• Screenshot