Cert-Pass
Log in Sign up
arrow_back Cert

AWS AWS Certified Machine Learning Engineer – Associate MLA-C01

🔥 0 streak
0%
timer Mock Exam lock Pro menu_book Course description 3-Page download Free
menu_book

AWS Certified Machine Learning Engineer – Associate MLA-C01

Compressed Course

AWS Certified Machine Learning Engineer – Associate MLA-C01 Exam Course

Purpose: A compressed but complete exam-preparation course for the AWS Certified Machine Learning Engineer – Associate (MLA-C01) certification.
Source basis: Consolidated from the provided MLA-C01 practice-question bank, with repeated ideas merged and service decisions organized into reusable rules.
Current exam alignment: MLA-C01 validates the ability to build, operationalize, deploy, and maintain machine-learning solutions and pipelines on AWS.


1. Exam Overview

What the exam is really testing

MLA-C01 is not a pure machine-learning theory exam and it is not a broad cloud-architecture exam. It tests whether you can take an ML workload from data preparation to production operations using the correct AWS services, with attention to cost, reliability, security, and maintainability.

Most questions are scenario-based. The exam rarely asks, “What does this service do?” Instead, it asks you to choose the best service or architecture for a specific constraint:

  • Low latency or offline inference?
  • Stateful streaming or simple delivery?
  • Shared features for training and inference?
  • Accuracy, recall, or precision?
  • Canary deployment or immediate replacement?
  • Reactive scaling or scheduled scaling?
  • IAM role or long-lived access key?
  • Data drift or infrastructure latency?
  • Athena, Glue, EMR, Flink, Lambda, or Data Firehose?

Your task is to identify the requirement that matters most, eliminate services that solve a different problem, and choose the least complex managed option that fully satisfies the scenario.

Official exam format

Item Current MLA-C01 exam detail
Total questions 65
Scored questions 50
Unscored questions 15
Passing scaled score 720 out of 1,000
Question styles Multiple choice, multiple response, ordering, matching
Scoring principle No penalty for guessing; unanswered questions are incorrect
Passing method Compensatory scoring across the full exam

Core exam mindset

Use this sequence for almost every question:

  1. Classify the problem: data, model, deployment, monitoring, cost, or security.
  2. Underline the decisive constraint: latency, scale, stateful processing, delayed labels, public exposure, cost threshold, auditability, or operational simplicity.
  3. Choose the AWS service designed for that job.
  4. Reject answers that solve a neighboring problem.
  5. Prefer managed and maintainable solutions unless the scenario explicitly requires custom control.

2. Exam Domains

The official blueprint contains four content domains.

Domain Weight Main exam focus
Content Domain 1: Data Preparation for Machine Learning (ML) 28% Ingest, store, transform, label, validate, secure, and prepare data
Content Domain 2: ML Model Development 26% Select approaches, train, tune, refine, evaluate, explain, and version models
Content Domain 3: Deployment and Orchestration of ML Workflows 22% Choose inference targets, provision infrastructure, scale endpoints, automate CI/CD
Content Domain 4: ML Solution Monitoring, Maintenance, and Security 24% Detect drift, monitor quality, troubleshoot performance, control cost, secure resources

Domain task statements

Content Domain 1: Data Preparation for Machine Learning (ML)

Task What you must know
1.1 Ingest and store data Formats, storage choices, batch and streaming ingestion, scaling, merging sources
1.2 Transform data and perform feature engineering Cleaning, encoding, scaling, transformations, Feature Store, labeling
1.3 Ensure data integrity and prepare data for modeling Bias, leakage, splitting, augmentation, encryption, masking, quality validation

Content Domain 2: ML Model Development

Task What you must know
2.1 Choose a modeling approach Algorithms, managed AI services, interpretability, pretrained models, cost
2.2 Train and refine models Training behavior, tuning, early stopping, regularization, fine-tuning, versioning
2.3 Analyze model performance Metrics, baselines, bias, explainability, convergence, shadow comparisons

Content Domain 3: Deployment and Orchestration of ML Workflows

Task What you must know
3.1 Select deployment infrastructure Real-time, batch, serverless, asynchronous, multi-model, multi-container, edge
3.2 Create and script infrastructure IaC, containers, VPC endpoints, scaling metrics, scheduled and reactive scaling
3.3 Automate orchestration and CI/CD CodePipeline, CodeBuild, CodeDeploy, EventBridge, Step Functions, SageMaker Pipelines, MWAA

Content Domain 4: ML Solution Monitoring, Maintenance, and Security

Task What you must know
4.1 Monitor model inference Data drift, model quality, delayed ground truth, A/B tests, anomaly detection
4.2 Monitor and optimize infrastructure and costs CloudWatch, CloudTrail, X-Ray, scaling, quotas, right-sizing, Budgets, Spot
4.3 Secure AWS resources IAM, KMS, Secrets Manager, S3 protections, VPC controls, CI/CD security

3. Start-to-Finish Study Path

Use this sequence so that each topic builds on the previous one.

Phase 1: Data foundation

Master these first:

  1. S3 formats and partitioning.
  2. Athena versus Glue versus EMR.
  3. Kinesis, Data Firehose, Flink, and Lambda.
  4. Data Wrangler, DataBrew, and Glue Data Quality.
  5. Feature Store online and offline access.
  6. Bias, leakage, splitting, PII masking, KMS encryption.

Checkpoint: You should be able to design a clean, governed path from raw data to training-ready features.

Phase 2: Model development

Study:

  1. Business problem to algorithm or managed AI service.
  2. Metrics: accuracy, precision, recall, F1, RMSE, ROC, AUC.
  3. Overfitting, underfitting, convergence, and catastrophic forgetting.
  4. Early stopping, regularization, distributed training, fine-tuning.
  5. SageMaker automatic model tuning.
  6. SageMaker Clarify, Model Debugger, JumpStart, and Model Registry.

Checkpoint: You should be able to justify a model-development decision using business cost, performance, explainability, and operational requirements.

Phase 3: Production deployment

Study:

  1. Real-time endpoint.
  2. Batch transform.
  3. Serverless inference.
  4. Asynchronous inference.
  5. Multi-model and multi-container endpoint patterns.
  6. Lambda, ECS, EKS, and edge optimization.
  7. Endpoint auto scaling and infrastructure as code.
  8. ECR and custom containers.

Checkpoint: You should be able to choose a deployment pattern from latency, traffic shape, payload size, processing time, cost, and model count.

Phase 4: Automation, monitoring, and security

Study:

  1. SageMaker Pipelines, EventBridge, Step Functions, and MWAA.
  2. CodeBuild, CodePipeline, CodeDeploy, and rollback strategies.
  3. Model Monitor, Clarify, CloudWatch, CloudTrail, X-Ray.
  4. Inference Recommender, Cost Explorer, Budgets, tagging.
  5. IAM roles, KMS permissions, Secrets Manager, S3 Block Public Access, and VPC endpoints.

Checkpoint: You should be able to operate the workload safely after deployment and troubleshoot the first production failure.


4. Core Concepts by Domain

Content Domain 1: Data Preparation for Machine Learning (ML)

4.1 Ingest and store data

Choose the data format from the access pattern

Format Best use Key benefit Common trap
Parquet Analytical datasets, Athena queries, feature engineering Columnar reads, compression, column pruning Choosing CSV because it is simple
ORC Columnar analytics Efficient scans and compression Treating it as a universal replacement without checking ecosystem fit
CSV Basic exchange, small files, human-readable exports Simple and portable Using it for large analytical scans
JSON Semi-structured records, event payloads Flexible schema Storing millions of tiny row-level objects
Avro Row-oriented serialization and schema evolution Efficient serialization Choosing it when Athena-style column pruning is the main requirement

Decision rule: If the scenario says Athena, analytical scans, small subset of columns, or reduce scan cost, choose Parquet and a sensible partition scheme.

S3 partitioning

Partition on columns that frequently appear in filters, such as:

  • Event date
  • Region
  • Tenant
  • Business unit
  • Data source

Avoid:

  • Random-only partition keys
  • Extremely high-cardinality partitions
  • One object per row
  • Millions of tiny objects

Small-files trap: Increasing prefixes does not fix the root problem if distributed jobs still open millions of tiny files. Compact files into appropriately sized objects while retaining useful partitions.

Storage selection

Requirement Best-fit service
Durable object storage and data lake Amazon S3
Block storage attached to compute Amazon EBS
Shared POSIX-style file system Amazon EFS
High-performance shared file workloads Amazon FSx
Archive, not active training Amazon S3 Glacier
Relational source data Amazon RDS
Key-value access pattern Amazon DynamoDB

Exam trap: Glacier is for archive and retrieval use cases. It is not the default active training-data tier.

Athena, Glue, and EMR

Requirement Choose
Serverless SQL query directly over S3 Amazon Athena
Catalog metadata and run managed ETL AWS Glue
Run Spark with deeper cluster-level control or customization Amazon EMR
Govern lake access centrally AWS Lake Formation

Elimination rule:
If the scenario says query S3 with SQL without provisioning servers, choose Athena.
If it says catalog, ETL, Spark transformation, or curated output, choose Glue.
If it says deep Spark customization, cluster control, or specialized big-data environment, consider EMR.

Batch versus streaming ingestion

Requirement Best-fit choice
Managed stream delivery to S3 with simple transformations Amazon Data Firehose
Stateful stream processing, windows, late events, rolling aggregates Amazon Managed Service for Apache Flink
Event ingestion stream Amazon Kinesis
Lightweight stateless per-event transformation AWS Lambda
Large historical distributed transformation AWS Glue or Amazon EMR

Key contrast: Data Firehose versus Flink

  • Data Firehose: Deliver streaming records to destinations such as S3 with minimal administration.
  • Flink: Stateful processing, windows, aggregations, event-time logic, and late arrivals.

If the question mentions rolling windows, out-of-order events, or stateful processing, Firehose alone is usually too limited.

Transfer and I/O optimization

Problem Solution
Long-distance S3 uploads from distributed locations S3 Transfer Acceleration
EBS-bound workload requiring predictable high IOPS EBS Provisioned IOPS
Small-file overhead in Spark jobs Compact files
Shared concurrent file access EFS or FSx

Do not confuse:

  • S3 Transfer Acceleration with EBS IOPS.
  • EBS IOPS with S3 scan optimization.
  • File compaction with network acceleration.

4.2 Transform data and engineer features

Core preprocessing operations

Problem Typical treatment
Missing numeric values Imputation based on data and model requirements
Extreme positive skew Log transform, clipping, robust scaling
Duplicate records Deduplication before splitting
Different numeric scales Standardization or normalization where algorithm-sensitive
Low-cardinality non-ordinal categories One-hot encoding
Ordinal categories Encode in a way that preserves meaningful order
Text input Tokenization appropriate to the model
Rare categories Grouping, hashing, or carefully selected encoding
Data leakage Correct split logic and point-in-time feature joins

Data Wrangler, DataBrew, Glue, and Glue Data Quality

Service Best use
SageMaker Data Wrangler Interactive ML-focused exploration, profiling, and transformation
AWS Glue DataBrew Visual, recipe-based, no-code-oriented data cleaning
AWS Glue Managed ETL and distributed transformations
AWS Glue Data Quality Automated data-quality checks and rules
Amazon EMR Spark processing with deeper customization

Exam trap: Data quality validation and visual cleaning are not identical:

  • Use DataBrew for visual cleaning.
  • Use Glue Data Quality for rule-based checks.
  • Use Data Wrangler for SageMaker-oriented interactive ML preparation.

SageMaker Feature Store

Use Feature Store when the same engineered features must be reused consistently across:

  • Offline training
  • Batch workflows
  • Low-latency online inference
  • Multiple models
  • Governed feature sharing
Store Use
Online store Low-latency feature retrieval during inference
Offline store Historical analysis and model training

Critical trap: point-in-time correctness

Historical training rows must use feature values that existed at the historical event time. Joining every row to the latest customer profile value leaks future information and inflates offline metrics.

Labeling

Requirement Choose
Managed human labeling workflow with quality controls SageMaker Ground Truth
Human review workflow for model predictions Amazon Augmented AI (A2I) where appropriate
External human task workforce integration Amazon Mechanical Turk where appropriate

4.3 Ensure data integrity and prepare for modeling

Data quality before training

Validate:

  • Completeness
  • Schema consistency
  • Range rules
  • Duplicate records
  • Missing segments
  • Unexpected categories
  • Data-type changes
  • Timestamp integrity
  • Label availability
  • Sensitive-data handling

Rule: Never retrain immediately after discovering missing segments or broken ingestion. Repair the source issue, rerun validation, and then retrain.

Splitting strategies

Dataset characteristic Split strategy
Standard classification dataset Train, validation, and test split
Rare but important labels Stratified splitting
Time-dependent prediction Time-aware split: earlier periods for training, later periods for validation
Related customer or device records Group-aware split when leakage is possible
Historical features Point-in-time-correct joins

Temporal-leakage trap: Random splitting is often wrong for forecasting and time-sensitive prediction.

Bias and SageMaker Clarify

Use SageMaker Clarify to analyze:

  • Pre-training bias
  • Class imbalance
  • Differences in label proportions
  • Feature contribution and explainability
  • Production changes that can affect fairness and performance

Mitigation techniques include:

  • Resampling
  • Augmentation
  • Synthetic-data generation
  • Better source coverage
  • Correct splitting
  • Feature review
  • Segment-based evaluation

PII, PHI, and compliance

Before training:

  1. Identify sensitive fields.
  2. Minimize unnecessary collection.
  3. Mask, anonymize, or tokenize as required.
  4. Encrypt at rest and in transit.
  5. Restrict data access with IAM roles.
  6. Respect residency and compliance obligations.

KMS trap: S3 access is not enough for a KMS-encrypted object. The execution role also needs appropriate KMS permissions and the key policy must permit the role.


Content Domain 2: ML Model Development

4.4 Choose a modeling approach

Start with the business problem

Problem type Typical approach
Predict a category Classification
Predict a numeric value Regression
Detect unusual behavior Anomaly detection
Group similar records without labels Clustering
Rank or recommend items Recommendation
Forecast future values Time-series forecasting
Generate or summarize content Foundation model / generative AI
Extract meaning from text NLP or managed AI service
Analyze images Computer vision or managed AI service

Use managed AI services when they solve the complete problem

Business requirement AWS service
Speech to text Amazon Transcribe
Text to speech Amazon Polly
Language translation Amazon Translate
OCR, forms, and tables from documents Amazon Textract
Sentiment and entity extraction from text Amazon Comprehend
Image and video analysis Amazon Rekognition
Personalized recommendations Amazon Personalize
Foundation-model access Amazon Bedrock
Search over enterprise content Amazon Kendra
Conversational interfaces Amazon Lex

Exam method: Before choosing custom SageMaker training, ask: “Does an AWS managed AI service already solve the complete requirement with less operational effort?”

Custom SageMaker modeling

Use SageMaker when you need:

  • Custom training
  • Algorithm choice
  • Custom features
  • Specialized evaluation
  • Custom containers
  • Training pipelines
  • Hyperparameter optimization
  • Model Registry
  • Custom deployment patterns

Interpretable versus complex models

Do not automatically select the most complex model.

Choose a simpler interpretable model when:

  • Auditors require understandable decisions.
  • Business users need reason codes.
  • The simpler model meets the performance threshold.
  • The incremental accuracy improvement of a complex model does not justify reduced explainability.

Strong baseline thinking

For tabular supervised-learning problems with nonlinear relationships, tree-based boosting such as XGBoost is often a strong baseline.

But do not force XGBoost onto every problem. Match algorithm families to:

  • Data type
  • Label availability
  • Feature count
  • Model-size requirement
  • Latency requirement
  • Explainability requirement
  • Training cost

Pretrained models and templates

Requirement Use
Pretrained model or solution template SageMaker JumpStart
Managed foundation-model API Amazon Bedrock
Adapt an existing model with custom data Fine-tuning
Avoid unnecessary training from scratch Reuse suitable pretrained models

4.5 Train and refine models

Training vocabulary

Concept Meaning
Epoch One pass through the training dataset
Batch size Number of samples processed before updating model parameters
Step One parameter-update iteration
Learning rate Size of each model update
Hyperparameter Configuration chosen before or around training, not directly learned from data
Objective metric Value optimized during tuning

Overfitting versus underfitting

Signal Interpretation Response
Training improves, validation worsens Overfitting Early stopping, regularization, feature selection, more representative data
Training and validation are both weak Underfitting Increase capacity, improve features, reconsider model family
Training oscillates or fails to settle Convergence issue Review learning rate, batch size, optimizer, data, Model Debugger
Narrow fine-tuning damages previous capability Catastrophic forgetting Adjust fine-tuning strategy and preserve representative behavior

Regularization

Technique Effect
Dropout Randomly disables units during training to improve generalization
L1 regularization Encourages sparsity
L2 regularization / weight decay Penalizes large weights
Feature selection Removes noisy or unnecessary inputs
Early stopping Ends training when validation improvement plateaus

Trap: Endpoint scaling does not fix overfitting. Serving capacity and model quality are different layers.

SageMaker automatic model tuning

Use SageMaker automatic model tuning when the scenario requires:

  • Managed hyperparameter search
  • Multiple candidate training jobs
  • Objective-metric comparison
  • Efficient exploration of parameter configurations

Possible techniques include random search and Bayesian optimization.

Distributed training

Evaluate distributed training when:

  • Training time is too long.
  • The framework and algorithm support parallel execution.
  • The dataset and model are large enough to benefit.
  • You will verify scaling efficiency.

Trap: More instances are not automatically better. Communication overhead can limit gains.

Script mode and custom containers

Requirement Best approach
Existing PyTorch or TensorFlow script SageMaker script mode with supported framework container
Specialized native inference libraries Custom container image in Amazon ECR
Existing model created outside SageMaker Bring your own model or bring your own container
Versioned runtime environment ECR image versioning

Reduce model size

Evaluate:

  • Pruning
  • Lower-precision data types where appropriate
  • Feature selection
  • Compression
  • Smaller architectures
  • Distillation where appropriate

Keep the exam focus practical: reduce model size while confirming acceptable accuracy, latency, and compatibility.

Model Registry

Use SageMaker Model Registry for:

  • Model-version tracking
  • Approval status
  • Metadata
  • Auditability
  • Repeatable deployment
  • Controlled promotion through environments

Governed sequence:

  1. Version data and code.
  2. Train and tune candidates.
  3. Evaluate against baselines.
  4. Register the approved candidate.
  5. Deploy through controlled automation.
  6. Monitor after release.

4.6 Analyze model performance

Classification metrics

Metric What it answers Prioritize when
Accuracy How often was the model correct overall? Classes are balanced and error costs are similar
Precision Of predicted positives, how many were correct? False positives are expensive
Recall Of actual positives, how many did the model find? False negatives are expensive
F1 score Harmonic balance of precision and recall You need a single score for imbalanced classification
Confusion matrix Where are false positives and false negatives occurring? You need detailed class-level behavior
ROC curve How does threshold choice change TPR and FPR? Comparing threshold tradeoffs
AUC How well does the classifier rank positives above negatives? Summary comparison across thresholds

Regression metrics

Metric Use
RMSE Penalizes larger prediction errors more strongly
MAE Average absolute error, easier to interpret and less sensitive to extreme errors
Residual analysis Identify systematic error patterns

Metric selection examples

Business requirement Metric emphasis
Minimize missed fraud Recall
Avoid costly false alerts Precision
Balance precision and recall F1
Predict delivery time RMSE or MAE
Analyze thresholds ROC and AUC
Evaluate minority class Class-specific precision, recall, F1, confusion matrix

Accuracy trap: A model predicting the majority class can look accurate while failing the business problem.

Clarify and Model Debugger

Capability Use
SageMaker Clarify Bias analysis and explainability
SageMaker Model Debugger Training behavior and convergence troubleshooting
SageMaker Model Monitor Production monitoring
Shadow variant Compare candidate behavior against production without changing user responses
A/B test Route controlled production traffic and compare outcomes

Shadow versus A/B test

  • Shadow: Candidate receives copied traffic but does not determine the customer response.
  • A/B: Candidate receives a controlled share of real traffic and affects actual responses.

Content Domain 3: Deployment and Orchestration of ML Workflows

4.7 Select deployment infrastructure

SageMaker inference patterns

Pattern Use when Avoid when
Real-time endpoint Synchronous low-latency API requests Workload is purely offline
Batch transform Scheduled offline scoring of files Interactive response is required
Serverless inference Infrequent or unpredictable requests; idle cost matters; cold starts acceptable Strict latency and unsupported model constraints
Asynchronous inference Large payloads or long-running requests that can be queued Immediate synchronous response required
Multi-model endpoint Many similar, lightly used models can share infrastructure Models require tightly chained containers
Multi-container endpoint Multiple containers need to run together or sequentially Main requirement is many tenant models

Decision tree

  1. Is the result needed immediately?

    • No → Batch transform for scheduled bulk scoring.
    • No, but each request arrives individually and may run for minutes → Asynchronous inference.
    • Yes → Continue.
  2. Is traffic intermittent and can cold starts be tolerated?

    • Yes → Consider serverless inference.
    • No → Real-time endpoint.
  3. Are there many lightly used similar models?

    • Yes → Consider multi-model endpoint.
  4. Are there multiple containers in a pipeline?

    • Yes → Consider multi-container endpoint.
  5. Is the deployment constrained by edge hardware?

    • Yes → Evaluate SageMaker Neo.

Other compute targets

Target Choose when
AWS Lambda Lightweight inference within Lambda constraints
Amazon ECS Container orchestration without Kubernetes requirement
Amazon EKS Kubernetes is an explicit platform requirement
Amazon EC2 Custom control is required
SageMaker endpoints Managed ML hosting is the best fit
Edge target with Neo Optimize compatible model for constrained hardware

EKS trap: Do not select Kubernetes merely because it is powerful. Choose EKS only when Kubernetes control or an existing Kubernetes platform is a real requirement.


4.8 Create and script infrastructure

Infrastructure as code

Use AWS CloudFormation or AWS CDK for:

  • Repeatable environments
  • Version control
  • Reduced drift
  • Automated deployment
  • Controlled promotion
  • Stack outputs and cross-stack references

Trap: Manual console provisioning is not a durable multi-environment strategy.

Containers and ECR

Use Amazon ECR to store:

  • Custom SageMaker training images
  • Custom inference images
  • Versioned container builds
  • BYOC runtime dependencies

Do not confuse:

  • ECR: Container image registry
  • CodeArtifact: Software package repository
  • S3: Object storage
  • Secrets Manager: Secret storage

Endpoint auto scaling

Key metrics include:

  • Invocations per instance
  • CPU utilization
  • Model latency
  • Backlog or queue-related signals where relevant
  • Custom CloudWatch metrics

Use:

Traffic pattern Scaling approach
Unpredictable workload Target-tracking or reactive scaling
Predictable weekday peak Scheduled scaling before the peak
Predictable plus variable traffic Combine scheduled and reactive scaling
Maximum capacity reached Review configured limits and service quotas

Scaling trap: A correctly triggered policy still cannot scale beyond the configured maximum or applicable quota.

Private networking

For sensitive SageMaker workloads:

  • Use VPC configuration.
  • Choose appropriate subnets.
  • Apply security groups.
  • Use private endpoints where applicable.
  • Review routes and outbound paths.
  • Avoid unnecessary public internet access.

4.9 Automate orchestration and CI/CD

Core orchestration services

Need Service
ML-native steps: processing, training, evaluation, registration SageMaker Pipelines
Release stages across source, build, test, deploy AWS CodePipeline
Compile, test, and build images AWS CodeBuild
Deployment automation and rollout integration AWS CodeDeploy where applicable
Event-driven or scheduled trigger Amazon EventBridge
Branching, retries, error handling, multiple AWS services AWS Step Functions
Managed Apache Airflow DAGs Amazon MWAA

Safe ML release flow

  1. Commit versioned code.
  2. Trigger pipeline.
  3. Run build and tests.
  4. Package runtime.
  5. Train or select candidate model.
  6. Evaluate against baseline.
  7. Register approved model.
  8. Deploy candidate variant.
  9. Shift traffic gradually.
  10. Monitor metrics.
  11. Promote or roll back.

Deployment strategies

Strategy Use
Canary Send a small initial traffic percentage to the new version
Linear Increase traffic gradually in steps
Blue/green Maintain separate environments and switch traffic
Immediate cutover Use only when risk is acceptable and rollback remains possible

Trap: Never delete the old model artifact before validating the new release.

Testing layers

Include:

  • Unit tests
  • Integration tests
  • End-to-end tests
  • Data-validation checks
  • Model-performance threshold checks
  • Rollback-condition tests
  • Security-policy validation

Content Domain 4: ML Solution Monitoring, Maintenance, and Security

4.10 Monitor model inference

Drift types

Type Meaning
Data drift Input-feature distribution changes
Model-quality degradation Prediction outcomes worsen
Bias drift Performance or fairness changes for segments
Concept drift Relationship between features and target changes
Infrastructure degradation Latency, throughput, availability, or capacity worsens

SageMaker Model Monitor

Use Model Monitor for production monitoring against baselines:

  • Data-quality checks
  • Model-quality monitoring
  • Bias-related monitoring where configured
  • Explainability-related monitoring where configured
  • Detection of deviations and violations

Delayed labels

When ground truth arrives later:

  1. Monitor input-data drift continuously as an early warning.
  2. Join delayed labels when available.
  3. Calculate model-quality metrics.
  4. Compare results with approved thresholds.
  5. Investigate segment-level changes.
  6. Trigger controlled retraining only when justified.

Trap: CPU utilization is not a model-quality metric.

A/B testing

Use A/B testing when:

  • A candidate receives a controlled share of actual traffic.
  • The business wants outcome comparison.
  • The rollout needs evidence before full promotion.

Use shadow variants when the candidate should not affect customer responses yet.

CloudWatch alarms

Create alarms for:

  • Error rate
  • Latency
  • Invocation count
  • Throttling
  • Capacity pressure
  • Queue backlog
  • Custom model or business metrics

4.11 Monitor and optimize infrastructure and costs

Operational tools

Need Tool
Metrics, dashboards, logs, alarms Amazon CloudWatch
Lambda-specific performance insight CloudWatch Lambda Insights
Search and analyze logs CloudWatch Logs Insights
API audit trail AWS CloudTrail
Distributed tracing AWS X-Ray
Event-driven operational reactions Amazon EventBridge
Rightsize SageMaker inference SageMaker Inference Recommender
Broader compute right-sizing AWS Compute Optimizer

Troubleshoot latency in the right order

  1. Review latency and invocation metrics.
  2. Check CPU, memory, GPU, and utilization where applicable.
  3. Review auto scaling target, minimum, maximum, and cooldown behavior.
  4. Check quotas.
  5. Inspect payload size and model runtime.
  6. Compare candidate instance families.
  7. Load test before changing the production design.

Cost tools

Need Tool
Actual and forecast budget threshold alerts AWS Budgets
Historical spend analysis by service and tag AWS Cost Explorer
Billing visibility AWS Billing and Cost Management
Cost allocation Resource tagging
Architecture recommendations AWS Trusted Advisor where relevant
Inference configuration comparison SageMaker Inference Recommender

Purchasing options

Workload Purchasing approach
Fault-tolerant training with checkpoint recovery Spot Instances
Unpredictable or short-term capacity On-Demand
Stable eligible long-term usage Savings Plans or reserved-style commitments where applicable
Strict production latency Right-size first, then scale appropriately

Spot trap: Store checkpoints durably. Instance-memory-only checkpoints can disappear after interruption.


4.12 Secure AWS resources

Least privilege

For every execution role:

  1. Identify required API actions.
  2. Scope resources narrowly.
  3. Restrict S3 prefixes.
  4. Restrict KMS keys.
  5. Restrict secrets.
  6. Use short-lived credentials.
  7. Review with audit logs.
  8. Separate environments and responsibilities.

Reject answers that use:

  • AdministratorAccess by default
  • Root credentials
  • Hard-coded access keys
  • Public buckets for convenience
  • Shared permanent credentials
  • Public endpoint exposure without requirement

S3 protection

Use:

  • S3 Block Public Access
  • Bucket policies
  • IAM roles
  • KMS encryption
  • VPC endpoints where needed
  • Logging and auditing
  • Data classification

KMS

Remember:

  • S3 permissions and KMS permissions are separate.
  • Encrypted-object access can fail even when s3:GetObject is allowed.
  • The role and key policy must allow the required decrypt operation.

Secrets Manager

Use AWS Secrets Manager for runtime credentials such as:

  • Database passwords
  • API keys
  • Rotating secrets
  • Sensitive connection details

Do not put secrets in:

  • Container images
  • Source repositories
  • Public S3 objects
  • Tags
  • Notebook output
  • Plain-text build variables without protection

VPC security

Review:

  • VPC
  • Subnets
  • Route tables
  • Security groups
  • Private endpoints
  • Outbound access paths
  • DNS and connectivity design
  • Network isolation requirements

Macie and CloudTrail

Service Security role
Amazon Macie Discover potentially sensitive data in S3
AWS CloudTrail Audit AWS API calls and identify the principal making changes
AWS KMS Encrypt and control cryptographic access
AWS Secrets Manager Securely store and rotate secrets
IAM Define identities, roles, policies, and least privilege

5. Service Selection Guide

Data and analytics services

Requirement phrase in the question Choose Eliminate
Query S3 with serverless SQL Athena Glue as the SQL query engine, Redshift for simple ad hoc inspection
Catalog and ETL data Glue Athena-only answer
Visual data cleaning Glue DataBrew Glue Data Quality as the cleaning UI
Rule-based data validation Glue Data Quality DataBrew-only answer
Stateful streaming windows Managed Service for Apache Flink Data Firehose alone
Simple managed stream delivery to S3 Data Firehose Flink if no stateful logic is needed
Deep Spark control EMR Lambda
Lightweight stateless event transformation Lambda Large Spark cluster
Reuse features online and offline SageMaker Feature Store Notebook-local files

SageMaker service guide

Requirement phrase Choose
Interactive ML data preparation Data Wrangler
Human labeling workflow Ground Truth
Bias and explainability Clarify
Production drift monitoring Model Monitor
Training convergence debugging Model Debugger
Managed hyperparameter search Automatic model tuning
Pretrained templates JumpStart
Governed model versions and approvals Model Registry
ML-native workflow graph SageMaker Pipelines
Edge-model optimization Neo
Benchmark endpoint configurations Inference Recommender

AI services guide

Need Service
Speech to text Transcribe
Text to speech Polly
Translation Translate
Document OCR Textract
Text sentiment and entities Comprehend
Image analysis Rekognition
Recommendations Personalize
Foundation models Bedrock

Deployment guide

Requirement phrase Choose
Immediate synchronous low-latency prediction Real-time endpoint
Offline file scoring Batch transform
Sporadic requests and acceptable cold starts Serverless inference
Large payloads or long-running queued requests Asynchronous inference
Many similar lightly used models Multi-model endpoint
Multiple chained containers Multi-container endpoint
Lightweight event-driven inference Lambda
Kubernetes requirement EKS
Versioned custom image ECR

Orchestration and CI/CD guide

Need Service
Coordinate release stages CodePipeline
Run build and test commands CodeBuild
Deployment automation CodeDeploy where applicable
Trigger workflows on events or schedule EventBridge
Branching, retries, error handling Step Functions
Airflow DAGs MWAA
ML workflow steps SageMaker Pipelines
Infrastructure as code CloudFormation or CDK

Operations and security guide

Need Service
Metrics and alarms CloudWatch
Audit API actions CloudTrail
Trace distributed requests X-Ray
Analyze historical cost Cost Explorer
Alert on spend thresholds Budgets
Discover sensitive S3 data Macie
Store runtime secrets Secrets Manager
Encryption keys KMS
Private S3 access from VPC S3 VPC endpoint

6. Architecture Patterns

Pattern 1: Batch training from an S3 lake

Raw sources
   |
   v
Amazon S3 landing zone
   |
   +--> AWS Glue Data Catalog
   |
   +--> AWS Glue / Amazon EMR transformation
   |
   +--> AWS Glue Data Quality validation
   |
   v
Curated Parquet training dataset
   |
   v
SageMaker training and tuning
   |
   v
Evaluation -> Model Registry -> Deployment

Use when:

  • Historical data is the main source.
  • Training runs on a schedule.
  • Athena and Glue are used for inspection and transformation.
  • Curated files benefit from Parquet and date-based partitioning.

Pattern 2: Streaming features

Event producers
   |
   v
Amazon Kinesis
   |
   +--> Data Firehose -----------------> Amazon S3
   |
   +--> Managed Service for Apache Flink
             |
             +--> Stateful aggregations
             +--> Rolling windows
             +--> Late-event handling
             |
             v
        Curated features / Feature Store

Use Firehose for delivery. Use Flink when stateful processing is required.

Pattern 3: Consistent online and offline features

Source events and batch data
   |
   v
Feature engineering pipeline
   |
   v
SageMaker Feature Store
   |
   +--> Online store --> Real-time inference
   |
   +--> Offline store --> Historical training and analysis

Important control: point-in-time-correct joins for offline training.

Pattern 4: Governed training pipeline

Versioned code + approved data
   |
   v
SageMaker Pipelines
   |
   +--> Processing
   +--> Training
   +--> Tuning
   +--> Evaluation
   +--> Conditional threshold
   +--> Register model
   |
   v
SageMaker Model Registry

Use when reproducibility, approval, and auditability matter.

Pattern 5: Low-latency real-time deployment

Client application
   |
   v
API layer
   |
   v
SageMaker real-time endpoint
   |
   +--> Auto scaling
   +--> CloudWatch metrics and alarms
   +--> Model Monitor
   +--> VPC controls where required

Use when synchronous latency is the decisive constraint.

Pattern 6: Controlled model release

Git commit
   |
   v
CodePipeline
   |
   +--> CodeBuild tests and image build
   +--> Candidate model validation
   +--> Deploy candidate variant
   +--> Canary or linear traffic shift
   +--> CloudWatch monitoring
   |
   +--> Promote
   |
   +--> Roll back

Pattern 7: Delayed-ground-truth monitoring

Production requests
   |
   v
Model predictions
   |
   +--> Immediate input-data drift monitoring
   |
   +--> Delayed business outcomes
             |
             v
        Model-quality calculations
             |
             v
     Investigation or retraining trigger

Pattern 8: Private encrypted ML workload

Private subnet
   |
   +--> SageMaker training or endpoint
   |
   +--> S3 VPC endpoint --> Encrypted S3 objects
   |
   +--> KMS authorization
   |
   +--> Secrets Manager for runtime credentials
   |
   +--> CloudTrail for audit

7. Exam Traps

Trap 1: Choosing a service from the wrong layer

The wrong answer often uses a real AWS service that solves a neighboring problem.

Scenario Correct layer Common wrong layer
Detect data drift Model monitoring Endpoint scaling
Fix overfitting Training and regularization Increase serving instances
Query S3 with SQL Analytics ETL cluster
Build a container image CI build Pipeline orchestration only
Store a runtime password Secret management Container registry
Audit an endpoint configuration change API logging Model compilation

Trap 2: Using Athena, Glue, and EMR interchangeably

Remember:

  • Athena queries S3 with serverless SQL.
  • Glue catalogs and transforms.
  • EMR provides deeper Spark and big-data control.

Trap 3: Using Data Firehose for stateful stream logic

Firehose is delivery-focused.
Flink is stateful-processing-focused.

Words that should push you toward Flink:

  • Windows
  • Rolling aggregate
  • Stateful
  • Out-of-order
  • Late events
  • Event-time processing

Trap 4: Confusing serverless inference and asynchronous inference

Serverless inference Asynchronous inference
Sporadic traffic Long-running request
Idle cost avoidance Larger payload or queued processing
Cold starts acceptable Result can arrive later
Fits serverless constraints Processing time may exceed normal synchronous behavior

Trap 5: Confusing multi-model and multi-container endpoints

Multi-model Multi-container
Many models share endpoint infrastructure Multiple containers form one serving path
Tenant-specific or lightly used models Preprocessing plus inference chain
Cost consolidation Dependency separation or pipeline sequence

Trap 6: Using accuracy for imbalanced data

If the minority class matters, accuracy alone is insufficient. Review:

  • Precision
  • Recall
  • F1
  • Confusion matrix
  • Threshold tradeoffs
  • Segment-level performance

Trap 7: Ignoring leakage

High offline scores can be a warning sign.

Check for:

  • Future information in training data
  • Latest-value feature joins
  • Duplicate records across splits
  • Related customer records crossing split boundaries
  • Random split for time-dependent prediction

Trap 8: Fixing a model-quality problem with infrastructure scaling

More endpoint instances can improve throughput and latency. They cannot fix:

  • Overfitting
  • Underfitting
  • Bias
  • Leakage
  • Drift
  • Wrong metric choice
  • Broken features

Trap 9: Treating S3 permissions as sufficient for encrypted data

For KMS-encrypted S3 objects, verify:

  • S3 object permission
  • KMS decrypt permission
  • KMS key policy
  • Correct execution role

Trap 10: Selecting the most powerful platform instead of the least complex adequate platform

Avoid EKS, EMR, or custom EC2 solutions when a managed simpler service fully meets the requirement.

Choose more control only when the scenario explicitly demands it.

Trap 11: Confusing CloudWatch and CloudTrail

CloudWatch CloudTrail
Metrics, logs, alarms, dashboards API audit events
Operational health Who changed what
Error rate and latency Principal and API activity

Trap 12: Forgetting rollback

A safe deployment keeps:

  • Previous version
  • Health metrics
  • Alarm conditions
  • Gradual traffic shift
  • Promotion and rollback path

8. Quick Memory Rules

Data rules

  • Athena asks questions; Glue prepares data.
  • Parquet for analytical scans.
  • Compact tiny files before blaming the network.
  • Data Firehose delivers; Flink thinks.
  • Feature Store prevents training-serving inconsistency.
  • Forecasting needs time-aware splits.
  • Encrypted S3 means S3 permission plus KMS permission.

Modeling rules

  • Managed AI service first, custom SageMaker when needed.
  • Missed positives hurt? Recall.
  • False alarms hurt? Precision.
  • Continuous prediction error? RMSE or MAE.
  • Validation worsens while training improves? Overfitting.
  • Both training and validation are weak? Underfitting.
  • Clarify explains and checks bias; Debugger inspects training.
  • Registry tracks approved model versions.

Deployment rules

  • Immediate response: real-time.
  • Offline file scoring: batch transform.
  • Sporadic traffic: serverless.
  • Long-running queued request: asynchronous.
  • Many models: multi-model.
  • Chained containers: multi-container.
  • Custom image: ECR.
  • Predictable peak: scheduled scaling.
  • Variable peak: reactive scaling.
  • Both patterns: combine both scaling methods.

Operations and security rules

  • CloudWatch watches; CloudTrail audits.
  • X-Ray traces.
  • Budgets alerts; Cost Explorer analyzes.
  • Macie discovers sensitive S3 data.
  • Secrets Manager stores credentials.
  • IAM roles beat long-lived keys.
  • Public buckets are almost never the answer.
  • Spot training requires durable checkpoints.

9. Final Revision Notes

Highest-value areas to revise repeatedly

  1. Inference-pattern selection

    • Real-time, batch, serverless, asynchronous, multi-model, multi-container.
  2. Data-service separation

    • Athena, Glue, EMR, DataBrew, Glue Data Quality, Data Firehose, Flink, Lambda.
  3. Feature integrity

    • Feature Store, point-in-time correctness, leakage, splitting, bias, PII.
  4. Model-quality reasoning

    • Precision, recall, F1, RMSE, ROC, AUC, confusion matrix.
  5. Training improvement

    • Early stopping, regularization, tuning, distributed training, fine-tuning.
  6. Lifecycle governance

    • SageMaker Pipelines, Model Registry, CodePipeline, CodeBuild, EventBridge.
  7. Monitoring separation

    • Data drift, model quality, infrastructure health, API audit, distributed tracing.
  8. Security

    • IAM roles, least privilege, KMS, Secrets Manager, S3 Block Public Access, VPC endpoints.

One-page comparison grid

Question signal Answer direction
Scan fewer S3 columns Parquet
Query S3 using SQL Athena
Catalog and ETL Glue
Visual cleaning DataBrew
ML-focused interactive preparation Data Wrangler
Data-quality rules Glue Data Quality
Simple stream delivery Data Firehose
Stateful streaming windows Flink
Shared online and offline features Feature Store
Human labeling Ground Truth
Bias or explainability Clarify
Training convergence Model Debugger
Model approvals and versions Model Registry
Pretrained templates JumpStart
Hyperparameter search Automatic model tuning
Low-latency inference Real-time endpoint
Scheduled offline predictions Batch transform
Sporadic endpoint traffic Serverless inference
Queued long-running prediction Asynchronous inference
Many lightly used models Multi-model endpoint
Multiple chained containers Multi-container endpoint
Custom container image ECR
Release stages CodePipeline
Build and tests CodeBuild
Event trigger EventBridge
Branching and retries Step Functions
Airflow DAG MWAA
ML workflow graph SageMaker Pipelines
Data drift Model Monitor
Metrics and alarms CloudWatch
API audit CloudTrail
Distributed trace X-Ray
Cost threshold Budgets
Cost analysis Cost Explorer
Sensitive S3-data discovery Macie
Runtime secret Secrets Manager
Encryption key KMS
Private S3 connectivity VPC endpoint

Last-minute elimination method

When two answers appear plausible:

  1. Remove options that solve a different lifecycle stage.
  2. Prefer the option that directly matches the named constraint.
  3. Reject broad permissions and public exposure.
  4. Prefer managed services unless customization is required.
  5. Distinguish model quality from infrastructure performance.
  6. Distinguish delivery from transformation.
  7. Distinguish synchronous, asynchronous, and batch inference.
  8. Check whether encryption requires both storage and KMS authorization.
  9. Check whether the scenario requires auditability or repeatability.
  10. Re-read the final sentence before selecting an answer.

10. Exam-Day Checklist

Before starting

  • Remember the four domains and their relative importance.
  • Expect multiple-choice, multiple-response, ordering, and matching questions.
  • Answer every question because there is no penalty for guessing.
  • Watch for hidden decisive words: low latency, stateful, offline, queued, audit, least privilege, delayed labels, predictable peak, cold start, point-in-time.

During the exam

  • Identify whether the question is about data, modeling, deployment, orchestration, monitoring, cost, or security.
  • Separate the primary requirement from background details.
  • Eliminate services that solve an adjacent but different problem.
  • Check whether the least complex managed service fully meets the requirement.
  • Treat public access, hard-coded secrets, root credentials, and AdministratorAccess as warning signs.
  • Use class-specific metrics for imbalanced models.
  • Use time-aware validation for forecasting.
  • Keep rollback and monitoring in production deployment answers.
  • Remember that S3 access and KMS decrypt permission are separate.
  • For multi-response questions, evaluate every option independently.

Final review

  • Revisit questions where two managed services looked similar.
  • Check Athena versus Glue versus EMR.
  • Check Data Firehose versus Flink.
  • Check DataBrew versus Glue Data Quality versus Data Wrangler.
  • Check real-time versus batch versus serverless versus asynchronous inference.
  • Check multi-model versus multi-container endpoints.
  • Check CloudWatch versus CloudTrail versus X-Ray.
  • Check Clarify versus Model Monitor versus Model Debugger.
  • Check Cost Explorer versus Budgets.
  • Submit an answer for every question.

Final memory sentence: Prepare clean data, choose the simplest correct model approach, deploy with the endpoint pattern that matches the workload, automate the lifecycle, monitor both quality and infrastructure, and secure every access path with least privilege.

lock_open

Unlock the full course

All 30 modules with detailed explanations, code examples, and exam tips.

workspace_premium
You've answered 0 of 35 free questions 1025 questions locked : these will appear on exam day.
0/35
rocket_launch Unlock All
event_available
Day 1 of 15 72 questions/day Finish by Jul 29, 2026
Question 2 of 1060
Content Domain 1: Data Preparation for Machine Learning (ML) · 28%

A regulated workload at an industrial manufacturer has the following constraint. A data lake contains S3 objects partitioned by event date. The engineer needs a serverless SQL query to validate a sample before training. Which service should be used?

0 correct
0 wrong
1060 left
0% done