Purpose: A compressed but complete exam-preparation course for the AWS Certified Machine Learning Engineer – Associate (MLA-C01) certification. Source basis: Consolidated from the provided MLA-C01 practice-question bank, with repeated ideas merged and service decisions organized into reusable rules. Current exam alignment: MLA-C01 validates the ability to build, operationalize, deploy, and maintain machine-learning solutions and pipelines on AWS.
1. Exam Overview
What the exam is really testing
MLA-C01 is not a pure machine-learning theory exam and it is not a broad cloud-architecture exam. It tests whether you can take an ML workload from data preparation to production operations using the correct AWS services, with attention to cost, reliability, security, and maintainability.
Most questions are scenario-based. The exam rarely asks, “What does this service do?” Instead, it asks you to choose the best service or architecture for a specific constraint:
Low latency or offline inference?
Stateful streaming or simple delivery?
Shared features for training and inference?
Accuracy, recall, or precision?
Canary deployment or immediate replacement?
Reactive scaling or scheduled scaling?
IAM role or long-lived access key?
Data drift or infrastructure latency?
Athena, Glue, EMR, Flink, Lambda, or Data Firehose?
Your task is to identify the requirement that matters most, eliminate services that solve a different problem, and choose the least complex managed option that fully satisfies the scenario.
Treating it as a universal replacement without checking ecosystem fit
CSV
Basic exchange, small files, human-readable exports
Simple and portable
Using it for large analytical scans
JSON
Semi-structured records, event payloads
Flexible schema
Storing millions of tiny row-level objects
Avro
Row-oriented serialization and schema evolution
Efficient serialization
Choosing it when Athena-style column pruning is the main requirement
Decision rule: If the scenario says Athena, analytical scans, small subset of columns, or reduce scan cost, choose Parquet and a sensible partition scheme.
S3 partitioning
Partition on columns that frequently appear in filters, such as:
Event date
Region
Tenant
Business unit
Data source
Avoid:
Random-only partition keys
Extremely high-cardinality partitions
One object per row
Millions of tiny objects
Small-files trap: Increasing prefixes does not fix the root problem if distributed jobs still open millions of tiny files. Compact files into appropriately sized objects while retaining useful partitions.
Storage selection
Requirement
Best-fit service
Durable object storage and data lake
Amazon S3
Block storage attached to compute
Amazon EBS
Shared POSIX-style file system
Amazon EFS
High-performance shared file workloads
Amazon FSx
Archive, not active training
Amazon S3 Glacier
Relational source data
Amazon RDS
Key-value access pattern
Amazon DynamoDB
Exam trap: Glacier is for archive and retrieval use cases. It is not the default active training-data tier.
Athena, Glue, and EMR
Requirement
Choose
Serverless SQL query directly over S3
Amazon Athena
Catalog metadata and run managed ETL
AWS Glue
Run Spark with deeper cluster-level control or customization
Amazon EMR
Govern lake access centrally
AWS Lake Formation
Elimination rule:
If the scenario says query S3 with SQL without provisioning servers, choose Athena.
If it says catalog, ETL, Spark transformation, or curated output, choose Glue.
If it says deep Spark customization, cluster control, or specialized big-data environment, consider EMR.
Batch versus streaming ingestion
Requirement
Best-fit choice
Managed stream delivery to S3 with simple transformations
Amazon Data Firehose
Stateful stream processing, windows, late events, rolling aggregates
Amazon Managed Service for Apache Flink
Event ingestion stream
Amazon Kinesis
Lightweight stateless per-event transformation
AWS Lambda
Large historical distributed transformation
AWS Glue or Amazon EMR
Key contrast: Data Firehose versus Flink
Data Firehose: Deliver streaming records to destinations such as S3 with minimal administration.
Flink: Stateful processing, windows, aggregations, event-time logic, and late arrivals.
If the question mentions rolling windows, out-of-order events, or stateful processing, Firehose alone is usually too limited.
Transfer and I/O optimization
Problem
Solution
Long-distance S3 uploads from distributed locations
S3 Transfer Acceleration
EBS-bound workload requiring predictable high IOPS
EBS Provisioned IOPS
Small-file overhead in Spark jobs
Compact files
Shared concurrent file access
EFS or FSx
Do not confuse:
S3 Transfer Acceleration with EBS IOPS.
EBS IOPS with S3 scan optimization.
File compaction with network acceleration.
4.2 Transform data and engineer features
Core preprocessing operations
Problem
Typical treatment
Missing numeric values
Imputation based on data and model requirements
Extreme positive skew
Log transform, clipping, robust scaling
Duplicate records
Deduplication before splitting
Different numeric scales
Standardization or normalization where algorithm-sensitive
Low-cardinality non-ordinal categories
One-hot encoding
Ordinal categories
Encode in a way that preserves meaningful order
Text input
Tokenization appropriate to the model
Rare categories
Grouping, hashing, or carefully selected encoding
Data leakage
Correct split logic and point-in-time feature joins
Data Wrangler, DataBrew, Glue, and Glue Data Quality
Service
Best use
SageMaker Data Wrangler
Interactive ML-focused exploration, profiling, and transformation
AWS Glue DataBrew
Visual, recipe-based, no-code-oriented data cleaning
AWS Glue
Managed ETL and distributed transformations
AWS Glue Data Quality
Automated data-quality checks and rules
Amazon EMR
Spark processing with deeper customization
Exam trap: Data quality validation and visual cleaning are not identical:
Use DataBrew for visual cleaning.
Use Glue Data Quality for rule-based checks.
Use Data Wrangler for SageMaker-oriented interactive ML preparation.
SageMaker Feature Store
Use Feature Store when the same engineered features must be reused consistently across:
Offline training
Batch workflows
Low-latency online inference
Multiple models
Governed feature sharing
Store
Use
Online store
Low-latency feature retrieval during inference
Offline store
Historical analysis and model training
Critical trap: point-in-time correctness
Historical training rows must use feature values that existed at the historical event time. Joining every row to the latest customer profile value leaks future information and inflates offline metrics.
Labeling
Requirement
Choose
Managed human labeling workflow with quality controls
SageMaker Ground Truth
Human review workflow for model predictions
Amazon Augmented AI (A2I) where appropriate
External human task workforce integration
Amazon Mechanical Turk where appropriate
4.3 Ensure data integrity and prepare for modeling
Data quality before training
Validate:
Completeness
Schema consistency
Range rules
Duplicate records
Missing segments
Unexpected categories
Data-type changes
Timestamp integrity
Label availability
Sensitive-data handling
Rule: Never retrain immediately after discovering missing segments or broken ingestion. Repair the source issue, rerun validation, and then retrain.
Splitting strategies
Dataset characteristic
Split strategy
Standard classification dataset
Train, validation, and test split
Rare but important labels
Stratified splitting
Time-dependent prediction
Time-aware split: earlier periods for training, later periods for validation
Related customer or device records
Group-aware split when leakage is possible
Historical features
Point-in-time-correct joins
Temporal-leakage trap: Random splitting is often wrong for forecasting and time-sensitive prediction.
Bias and SageMaker Clarify
Use SageMaker Clarify to analyze:
Pre-training bias
Class imbalance
Differences in label proportions
Feature contribution and explainability
Production changes that can affect fairness and performance
Mitigation techniques include:
Resampling
Augmentation
Synthetic-data generation
Better source coverage
Correct splitting
Feature review
Segment-based evaluation
PII, PHI, and compliance
Before training:
Identify sensitive fields.
Minimize unnecessary collection.
Mask, anonymize, or tokenize as required.
Encrypt at rest and in transit.
Restrict data access with IAM roles.
Respect residency and compliance obligations.
KMS trap: S3 access is not enough for a KMS-encrypted object. The execution role also needs appropriate KMS permissions and the key policy must permit the role.
Content Domain 2: ML Model Development
4.4 Choose a modeling approach
Start with the business problem
Problem type
Typical approach
Predict a category
Classification
Predict a numeric value
Regression
Detect unusual behavior
Anomaly detection
Group similar records without labels
Clustering
Rank or recommend items
Recommendation
Forecast future values
Time-series forecasting
Generate or summarize content
Foundation model / generative AI
Extract meaning from text
NLP or managed AI service
Analyze images
Computer vision or managed AI service
Use managed AI services when they solve the complete problem
Business requirement
AWS service
Speech to text
Amazon Transcribe
Text to speech
Amazon Polly
Language translation
Amazon Translate
OCR, forms, and tables from documents
Amazon Textract
Sentiment and entity extraction from text
Amazon Comprehend
Image and video analysis
Amazon Rekognition
Personalized recommendations
Amazon Personalize
Foundation-model access
Amazon Bedrock
Search over enterprise content
Amazon Kendra
Conversational interfaces
Amazon Lex
Exam method: Before choosing custom SageMaker training, ask: “Does an AWS managed AI service already solve the complete requirement with less operational effort?”
Custom SageMaker modeling
Use SageMaker when you need:
Custom training
Algorithm choice
Custom features
Specialized evaluation
Custom containers
Training pipelines
Hyperparameter optimization
Model Registry
Custom deployment patterns
Interpretable versus complex models
Do not automatically select the most complex model.
Choose a simpler interpretable model when:
Auditors require understandable decisions.
Business users need reason codes.
The simpler model meets the performance threshold.
The incremental accuracy improvement of a complex model does not justify reduced explainability.
Strong baseline thinking
For tabular supervised-learning problems with nonlinear relationships, tree-based boosting such as XGBoost is often a strong baseline.
But do not force XGBoost onto every problem. Match algorithm families to:
Data type
Label availability
Feature count
Model-size requirement
Latency requirement
Explainability requirement
Training cost
Pretrained models and templates
Requirement
Use
Pretrained model or solution template
SageMaker JumpStart
Managed foundation-model API
Amazon Bedrock
Adapt an existing model with custom data
Fine-tuning
Avoid unnecessary training from scratch
Reuse suitable pretrained models
4.5 Train and refine models
Training vocabulary
Concept
Meaning
Epoch
One pass through the training dataset
Batch size
Number of samples processed before updating model parameters
Step
One parameter-update iteration
Learning rate
Size of each model update
Hyperparameter
Configuration chosen before or around training, not directly learned from data
Objective metric
Value optimized during tuning
Overfitting versus underfitting
Signal
Interpretation
Response
Training improves, validation worsens
Overfitting
Early stopping, regularization, feature selection, more representative data
Training and validation are both weak
Underfitting
Increase capacity, improve features, reconsider model family
Training oscillates or fails to settle
Convergence issue
Review learning rate, batch size, optimizer, data, Model Debugger
Narrow fine-tuning damages previous capability
Catastrophic forgetting
Adjust fine-tuning strategy and preserve representative behavior
Regularization
Technique
Effect
Dropout
Randomly disables units during training to improve generalization
L1 regularization
Encourages sparsity
L2 regularization / weight decay
Penalizes large weights
Feature selection
Removes noisy or unnecessary inputs
Early stopping
Ends training when validation improvement plateaus
Trap: Endpoint scaling does not fix overfitting. Serving capacity and model quality are different layers.
SageMaker automatic model tuning
Use SageMaker automatic model tuning when the scenario requires:
Managed hyperparameter search
Multiple candidate training jobs
Objective-metric comparison
Efficient exploration of parameter configurations
Possible techniques include random search and Bayesian optimization.
Distributed training
Evaluate distributed training when:
Training time is too long.
The framework and algorithm support parallel execution.
The dataset and model are large enough to benefit.
You will verify scaling efficiency.
Trap: More instances are not automatically better. Communication overhead can limit gains.
Script mode and custom containers
Requirement
Best approach
Existing PyTorch or TensorFlow script
SageMaker script mode with supported framework container
Specialized native inference libraries
Custom container image in Amazon ECR
Existing model created outside SageMaker
Bring your own model or bring your own container
Versioned runtime environment
ECR image versioning
Reduce model size
Evaluate:
Pruning
Lower-precision data types where appropriate
Feature selection
Compression
Smaller architectures
Distillation where appropriate
Keep the exam focus practical: reduce model size while confirming acceptable accuracy, latency, and compatibility.
Model Registry
Use SageMaker Model Registry for:
Model-version tracking
Approval status
Metadata
Auditability
Repeatable deployment
Controlled promotion through environments
Governed sequence:
Version data and code.
Train and tune candidates.
Evaluate against baselines.
Register the approved candidate.
Deploy through controlled automation.
Monitor after release.
4.6 Analyze model performance
Classification metrics
Metric
What it answers
Prioritize when
Accuracy
How often was the model correct overall?
Classes are balanced and error costs are similar
Precision
Of predicted positives, how many were correct?
False positives are expensive
Recall
Of actual positives, how many did the model find?
False negatives are expensive
F1 score
Harmonic balance of precision and recall
You need a single score for imbalanced classification
Confusion matrix
Where are false positives and false negatives occurring?
You need detailed class-level behavior
ROC curve
How does threshold choice change TPR and FPR?
Comparing threshold tradeoffs
AUC
How well does the classifier rank positives above negatives?
Summary comparison across thresholds
Regression metrics
Metric
Use
RMSE
Penalizes larger prediction errors more strongly
MAE
Average absolute error, easier to interpret and less sensitive to extreme errors
Accuracy trap: A model predicting the majority class can look accurate while failing the business problem.
Clarify and Model Debugger
Capability
Use
SageMaker Clarify
Bias analysis and explainability
SageMaker Model Debugger
Training behavior and convergence troubleshooting
SageMaker Model Monitor
Production monitoring
Shadow variant
Compare candidate behavior against production without changing user responses
A/B test
Route controlled production traffic and compare outcomes
Shadow versus A/B test
Shadow: Candidate receives copied traffic but does not determine the customer response.
A/B: Candidate receives a controlled share of real traffic and affects actual responses.
Content Domain 3: Deployment and Orchestration of ML Workflows
4.7 Select deployment infrastructure
SageMaker inference patterns
Pattern
Use when
Avoid when
Real-time endpoint
Synchronous low-latency API requests
Workload is purely offline
Batch transform
Scheduled offline scoring of files
Interactive response is required
Serverless inference
Infrequent or unpredictable requests; idle cost matters; cold starts acceptable
Strict latency and unsupported model constraints
Asynchronous inference
Large payloads or long-running requests that can be queued
Immediate synchronous response required
Multi-model endpoint
Many similar, lightly used models can share infrastructure
Models require tightly chained containers
Multi-container endpoint
Multiple containers need to run together or sequentially
Main requirement is many tenant models
Decision tree
Is the result needed immediately?
No → Batch transform for scheduled bulk scoring.
No, but each request arrives individually and may run for minutes → Asynchronous inference.
Yes → Continue.
Is traffic intermittent and can cold starts be tolerated?
Yes → Consider serverless inference.
No → Real-time endpoint.
Are there many lightly used similar models?
Yes → Consider multi-model endpoint.
Are there multiple containers in a pipeline?
Yes → Consider multi-container endpoint.
Is the deployment constrained by edge hardware?
Yes → Evaluate SageMaker Neo.
Other compute targets
Target
Choose when
AWS Lambda
Lightweight inference within Lambda constraints
Amazon ECS
Container orchestration without Kubernetes requirement
Amazon EKS
Kubernetes is an explicit platform requirement
Amazon EC2
Custom control is required
SageMaker endpoints
Managed ML hosting is the best fit
Edge target with Neo
Optimize compatible model for constrained hardware
EKS trap: Do not select Kubernetes merely because it is powerful. Choose EKS only when Kubernetes control or an existing Kubernetes platform is a real requirement.
4.8 Create and script infrastructure
Infrastructure as code
Use AWS CloudFormation or AWS CDK for:
Repeatable environments
Version control
Reduced drift
Automated deployment
Controlled promotion
Stack outputs and cross-stack references
Trap: Manual console provisioning is not a durable multi-environment strategy.
Containers and ECR
Use Amazon ECR to store:
Custom SageMaker training images
Custom inference images
Versioned container builds
BYOC runtime dependencies
Do not confuse:
ECR: Container image registry
CodeArtifact: Software package repository
S3: Object storage
Secrets Manager: Secret storage
Endpoint auto scaling
Key metrics include:
Invocations per instance
CPU utilization
Model latency
Backlog or queue-related signals where relevant
Custom CloudWatch metrics
Use:
Traffic pattern
Scaling approach
Unpredictable workload
Target-tracking or reactive scaling
Predictable weekday peak
Scheduled scaling before the peak
Predictable plus variable traffic
Combine scheduled and reactive scaling
Maximum capacity reached
Review configured limits and service quotas
Scaling trap: A correctly triggered policy still cannot scale beyond the configured maximum or applicable quota.
Send a small initial traffic percentage to the new version
Linear
Increase traffic gradually in steps
Blue/green
Maintain separate environments and switch traffic
Immediate cutover
Use only when risk is acceptable and rollback remains possible
Trap: Never delete the old model artifact before validating the new release.
Testing layers
Include:
Unit tests
Integration tests
End-to-end tests
Data-validation checks
Model-performance threshold checks
Rollback-condition tests
Security-policy validation
Content Domain 4: ML Solution Monitoring, Maintenance, and Security
4.10 Monitor model inference
Drift types
Type
Meaning
Data drift
Input-feature distribution changes
Model-quality degradation
Prediction outcomes worsen
Bias drift
Performance or fairness changes for segments
Concept drift
Relationship between features and target changes
Infrastructure degradation
Latency, throughput, availability, or capacity worsens
SageMaker Model Monitor
Use Model Monitor for production monitoring against baselines:
Data-quality checks
Model-quality monitoring
Bias-related monitoring where configured
Explainability-related monitoring where configured
Detection of deviations and violations
Delayed labels
When ground truth arrives later:
Monitor input-data drift continuously as an early warning.
Join delayed labels when available.
Calculate model-quality metrics.
Compare results with approved thresholds.
Investigate segment-level changes.
Trigger controlled retraining only when justified.
Trap: CPU utilization is not a model-quality metric.
A/B testing
Use A/B testing when:
A candidate receives a controlled share of actual traffic.
The business wants outcome comparison.
The rollout needs evidence before full promotion.
Use shadow variants when the candidate should not affect customer responses yet.
CloudWatch alarms
Create alarms for:
Error rate
Latency
Invocation count
Throttling
Capacity pressure
Queue backlog
Custom model or business metrics
4.11 Monitor and optimize infrastructure and costs
Operational tools
Need
Tool
Metrics, dashboards, logs, alarms
Amazon CloudWatch
Lambda-specific performance insight
CloudWatch Lambda Insights
Search and analyze logs
CloudWatch Logs Insights
API audit trail
AWS CloudTrail
Distributed tracing
AWS X-Ray
Event-driven operational reactions
Amazon EventBridge
Rightsize SageMaker inference
SageMaker Inference Recommender
Broader compute right-sizing
AWS Compute Optimizer
Troubleshoot latency in the right order
Review latency and invocation metrics.
Check CPU, memory, GPU, and utilization where applicable.
Review auto scaling target, minimum, maximum, and cooldown behavior.
Check quotas.
Inspect payload size and model runtime.
Compare candidate instance families.
Load test before changing the production design.
Cost tools
Need
Tool
Actual and forecast budget threshold alerts
AWS Budgets
Historical spend analysis by service and tag
AWS Cost Explorer
Billing visibility
AWS Billing and Cost Management
Cost allocation
Resource tagging
Architecture recommendations
AWS Trusted Advisor where relevant
Inference configuration comparison
SageMaker Inference Recommender
Purchasing options
Workload
Purchasing approach
Fault-tolerant training with checkpoint recovery
Spot Instances
Unpredictable or short-term capacity
On-Demand
Stable eligible long-term usage
Savings Plans or reserved-style commitments where applicable
Strict production latency
Right-size first, then scale appropriately
Spot trap: Store checkpoints durably. Instance-memory-only checkpoints can disappear after interruption.
4.12 Secure AWS resources
Least privilege
For every execution role:
Identify required API actions.
Scope resources narrowly.
Restrict S3 prefixes.
Restrict KMS keys.
Restrict secrets.
Use short-lived credentials.
Review with audit logs.
Separate environments and responsibilities.
Reject answers that use:
AdministratorAccess by default
Root credentials
Hard-coded access keys
Public buckets for convenience
Shared permanent credentials
Public endpoint exposure without requirement
S3 protection
Use:
S3 Block Public Access
Bucket policies
IAM roles
KMS encryption
VPC endpoints where needed
Logging and auditing
Data classification
KMS
Remember:
S3 permissions and KMS permissions are separate.
Encrypted-object access can fail even when s3:GetObject is allowed.
The role and key policy must allow the required decrypt operation.
Secrets Manager
Use AWS Secrets Manager for runtime credentials such as:
Database passwords
API keys
Rotating secrets
Sensitive connection details
Do not put secrets in:
Container images
Source repositories
Public S3 objects
Tags
Notebook output
Plain-text build variables without protection
VPC security
Review:
VPC
Subnets
Route tables
Security groups
Private endpoints
Outbound access paths
DNS and connectivity design
Network isolation requirements
Macie and CloudTrail
Service
Security role
Amazon Macie
Discover potentially sensitive data in S3
AWS CloudTrail
Audit AWS API calls and identify the principal making changes
AWS KMS
Encrypt and control cryptographic access
AWS Secrets Manager
Securely store and rotate secrets
IAM
Define identities, roles, policies, and least privilege
5. Service Selection Guide
Data and analytics services
Requirement phrase in the question
Choose
Eliminate
Query S3 with serverless SQL
Athena
Glue as the SQL query engine, Redshift for simple ad hoc inspection
Catalog and ETL data
Glue
Athena-only answer
Visual data cleaning
Glue DataBrew
Glue Data Quality as the cleaning UI
Rule-based data validation
Glue Data Quality
DataBrew-only answer
Stateful streaming windows
Managed Service for Apache Flink
Data Firehose alone
Simple managed stream delivery to S3
Data Firehose
Flink if no stateful logic is needed
Deep Spark control
EMR
Lambda
Lightweight stateless event transformation
Lambda
Large Spark cluster
Reuse features online and offline
SageMaker Feature Store
Notebook-local files
SageMaker service guide
Requirement phrase
Choose
Interactive ML data preparation
Data Wrangler
Human labeling workflow
Ground Truth
Bias and explainability
Clarify
Production drift monitoring
Model Monitor
Training convergence debugging
Model Debugger
Managed hyperparameter search
Automatic model tuning
Pretrained templates
JumpStart
Governed model versions and approvals
Model Registry
ML-native workflow graph
SageMaker Pipelines
Edge-model optimization
Neo
Benchmark endpoint configurations
Inference Recommender
AI services guide
Need
Service
Speech to text
Transcribe
Text to speech
Polly
Translation
Translate
Document OCR
Textract
Text sentiment and entities
Comprehend
Image analysis
Rekognition
Recommendations
Personalize
Foundation models
Bedrock
Deployment guide
Requirement phrase
Choose
Immediate synchronous low-latency prediction
Real-time endpoint
Offline file scoring
Batch transform
Sporadic requests and acceptable cold starts
Serverless inference
Large payloads or long-running queued requests
Asynchronous inference
Many similar lightly used models
Multi-model endpoint
Multiple chained containers
Multi-container endpoint
Lightweight event-driven inference
Lambda
Kubernetes requirement
EKS
Versioned custom image
ECR
Orchestration and CI/CD guide
Need
Service
Coordinate release stages
CodePipeline
Run build and test commands
CodeBuild
Deployment automation
CodeDeploy where applicable
Trigger workflows on events or schedule
EventBridge
Branching, retries, error handling
Step Functions
Airflow DAGs
MWAA
ML workflow steps
SageMaker Pipelines
Infrastructure as code
CloudFormation or CDK
Operations and security guide
Need
Service
Metrics and alarms
CloudWatch
Audit API actions
CloudTrail
Trace distributed requests
X-Ray
Analyze historical cost
Cost Explorer
Alert on spend thresholds
Budgets
Discover sensitive S3 data
Macie
Store runtime secrets
Secrets Manager
Encryption keys
KMS
Private S3 access from VPC
S3 VPC endpoint
6. Architecture Patterns
Pattern 1: Batch training from an S3 lake
Raw sources
|
v
Amazon S3 landing zone
|
+--> AWS Glue Data Catalog
|
+--> AWS Glue / Amazon EMR transformation
|
+--> AWS Glue Data Quality validation
|
v
Curated Parquet training dataset
|
v
SageMaker training and tuning
|
v
Evaluation -> Model Registry -> Deployment
Use when:
Historical data is the main source.
Training runs on a schedule.
Athena and Glue are used for inspection and transformation.
Curated files benefit from Parquet and date-based partitioning.
Pattern 2: Streaming features
Event producers
|
v
Amazon Kinesis
|
+--> Data Firehose -----------------> Amazon S3
|
+--> Managed Service for Apache Flink
|
+--> Stateful aggregations
+--> Rolling windows
+--> Late-event handling
|
v
Curated features / Feature Store
Use Firehose for delivery. Use Flink when stateful processing is required.
Pattern 3: Consistent online and offline features
Source events and batch data
|
v
Feature engineering pipeline
|
v
SageMaker Feature Store
|
+--> Online store --> Real-time inference
|
+--> Offline store --> Historical training and analysis
Important control: point-in-time-correct joins for offline training.
Pattern 4: Governed training pipeline
Versioned code + approved data
|
v
SageMaker Pipelines
|
+--> Processing
+--> Training
+--> Tuning
+--> Evaluation
+--> Conditional threshold
+--> Register model
|
v
SageMaker Model Registry
Use when reproducibility, approval, and auditability matter.
Pattern 5: Low-latency real-time deployment
Client application
|
v
API layer
|
v
SageMaker real-time endpoint
|
+--> Auto scaling
+--> CloudWatch metrics and alarms
+--> Model Monitor
+--> VPC controls where required
Use when synchronous latency is the decisive constraint.
Pattern 6: Controlled model release
Git commit
|
v
CodePipeline
|
+--> CodeBuild tests and image build
+--> Candidate model validation
+--> Deploy candidate variant
+--> Canary or linear traffic shift
+--> CloudWatch monitoring
|
+--> Promote
|
+--> Roll back
Pattern 7: Delayed-ground-truth monitoring
Production requests
|
v
Model predictions
|
+--> Immediate input-data drift monitoring
|
+--> Delayed business outcomes
|
v
Model-quality calculations
|
v
Investigation or retraining trigger
Pattern 8: Private encrypted ML workload
Private subnet
|
+--> SageMaker training or endpoint
|
+--> S3 VPC endpoint --> Encrypted S3 objects
|
+--> KMS authorization
|
+--> Secrets Manager for runtime credentials
|
+--> CloudTrail for audit
7. Exam Traps
Trap 1: Choosing a service from the wrong layer
The wrong answer often uses a real AWS service that solves a neighboring problem.
Scenario
Correct layer
Common wrong layer
Detect data drift
Model monitoring
Endpoint scaling
Fix overfitting
Training and regularization
Increase serving instances
Query S3 with SQL
Analytics
ETL cluster
Build a container image
CI build
Pipeline orchestration only
Store a runtime password
Secret management
Container registry
Audit an endpoint configuration change
API logging
Model compilation
Trap 2: Using Athena, Glue, and EMR interchangeably
Remember:
Athena queries S3 with serverless SQL.
Glue catalogs and transforms.
EMR provides deeper Spark and big-data control.
Trap 3: Using Data Firehose for stateful stream logic
Firehose is delivery-focused.
Flink is stateful-processing-focused.
Words that should push you toward Flink:
Windows
Rolling aggregate
Stateful
Out-of-order
Late events
Event-time processing
Trap 4: Confusing serverless inference and asynchronous inference
Serverless inference
Asynchronous inference
Sporadic traffic
Long-running request
Idle cost avoidance
Larger payload or queued processing
Cold starts acceptable
Result can arrive later
Fits serverless constraints
Processing time may exceed normal synchronous behavior
Trap 5: Confusing multi-model and multi-container endpoints
Multi-model
Multi-container
Many models share endpoint infrastructure
Multiple containers form one serving path
Tenant-specific or lightly used models
Preprocessing plus inference chain
Cost consolidation
Dependency separation or pipeline sequence
Trap 6: Using accuracy for imbalanced data
If the minority class matters, accuracy alone is insufficient. Review:
Precision
Recall
F1
Confusion matrix
Threshold tradeoffs
Segment-level performance
Trap 7: Ignoring leakage
High offline scores can be a warning sign.
Check for:
Future information in training data
Latest-value feature joins
Duplicate records across splits
Related customer records crossing split boundaries
Random split for time-dependent prediction
Trap 8: Fixing a model-quality problem with infrastructure scaling
More endpoint instances can improve throughput and latency. They cannot fix:
Overfitting
Underfitting
Bias
Leakage
Drift
Wrong metric choice
Broken features
Trap 9: Treating S3 permissions as sufficient for encrypted data
For KMS-encrypted S3 objects, verify:
S3 object permission
KMS decrypt permission
KMS key policy
Correct execution role
Trap 10: Selecting the most powerful platform instead of the least complex adequate platform
Avoid EKS, EMR, or custom EC2 solutions when a managed simpler service fully meets the requirement.
Choose more control only when the scenario explicitly demands it.
Trap 11: Confusing CloudWatch and CloudTrail
CloudWatch
CloudTrail
Metrics, logs, alarms, dashboards
API audit events
Operational health
Who changed what
Error rate and latency
Principal and API activity
Trap 12: Forgetting rollback
A safe deployment keeps:
Previous version
Health metrics
Alarm conditions
Gradual traffic shift
Promotion and rollback path
8. Quick Memory Rules
Data rules
Athena asks questions; Glue prepares data.
Parquet for analytical scans.
Compact tiny files before blaming the network.
Data Firehose delivers; Flink thinks.
Feature Store prevents training-serving inconsistency.
Forecasting needs time-aware splits.
Encrypted S3 means S3 permission plus KMS permission.
Modeling rules
Managed AI service first, custom SageMaker when needed.
Missed positives hurt? Recall.
False alarms hurt? Precision.
Continuous prediction error? RMSE or MAE.
Validation worsens while training improves? Overfitting.
Both training and validation are weak? Underfitting.
Clarify explains and checks bias; Debugger inspects training.
Early stopping, regularization, tuning, distributed training, fine-tuning.
Lifecycle governance
SageMaker Pipelines, Model Registry, CodePipeline, CodeBuild, EventBridge.
Monitoring separation
Data drift, model quality, infrastructure health, API audit, distributed tracing.
Security
IAM roles, least privilege, KMS, Secrets Manager, S3 Block Public Access, VPC endpoints.
One-page comparison grid
Question signal
Answer direction
Scan fewer S3 columns
Parquet
Query S3 using SQL
Athena
Catalog and ETL
Glue
Visual cleaning
DataBrew
ML-focused interactive preparation
Data Wrangler
Data-quality rules
Glue Data Quality
Simple stream delivery
Data Firehose
Stateful streaming windows
Flink
Shared online and offline features
Feature Store
Human labeling
Ground Truth
Bias or explainability
Clarify
Training convergence
Model Debugger
Model approvals and versions
Model Registry
Pretrained templates
JumpStart
Hyperparameter search
Automatic model tuning
Low-latency inference
Real-time endpoint
Scheduled offline predictions
Batch transform
Sporadic endpoint traffic
Serverless inference
Queued long-running prediction
Asynchronous inference
Many lightly used models
Multi-model endpoint
Multiple chained containers
Multi-container endpoint
Custom container image
ECR
Release stages
CodePipeline
Build and tests
CodeBuild
Event trigger
EventBridge
Branching and retries
Step Functions
Airflow DAG
MWAA
ML workflow graph
SageMaker Pipelines
Data drift
Model Monitor
Metrics and alarms
CloudWatch
API audit
CloudTrail
Distributed trace
X-Ray
Cost threshold
Budgets
Cost analysis
Cost Explorer
Sensitive S3-data discovery
Macie
Runtime secret
Secrets Manager
Encryption key
KMS
Private S3 connectivity
VPC endpoint
Last-minute elimination method
When two answers appear plausible:
Remove options that solve a different lifecycle stage.
Prefer the option that directly matches the named constraint.
Reject broad permissions and public exposure.
Prefer managed services unless customization is required.
Distinguish model quality from infrastructure performance.
Distinguish delivery from transformation.
Distinguish synchronous, asynchronous, and batch inference.
Check whether encryption requires both storage and KMS authorization.
Check whether the scenario requires auditability or repeatability.
Re-read the final sentence before selecting an answer.
10. Exam-Day Checklist
Before starting
Remember the four domains and their relative importance.
Expect multiple-choice, multiple-response, ordering, and matching questions.
Answer every question because there is no penalty for guessing.
Watch for hidden decisive words: low latency, stateful, offline, queued, audit, least privilege, delayed labels, predictable peak, cold start, point-in-time.
During the exam
Identify whether the question is about data, modeling, deployment, orchestration, monitoring, cost, or security.
Separate the primary requirement from background details.
Eliminate services that solve an adjacent but different problem.
Check whether the least complex managed service fully meets the requirement.
Treat public access, hard-coded secrets, root credentials, and AdministratorAccess as warning signs.
Use class-specific metrics for imbalanced models.
Use time-aware validation for forecasting.
Keep rollback and monitoring in production deployment answers.
Remember that S3 access and KMS decrypt permission are separate.
For multi-response questions, evaluate every option independently.
Final review
Revisit questions where two managed services looked similar.
Check Athena versus Glue versus EMR.
Check Data Firehose versus Flink.
Check DataBrew versus Glue Data Quality versus Data Wrangler.
Check real-time versus batch versus serverless versus asynchronous inference.
Check multi-model versus multi-container endpoints.
Check CloudWatch versus CloudTrail versus X-Ray.
Check Clarify versus Model Monitor versus Model Debugger.
Check Cost Explorer versus Budgets.
Submit an answer for every question.
Final memory sentence: Prepare clean data, choose the simplest correct model approach, deploy with the endpoint pattern that matches the workload, automate the lifecycle, monitor both quality and infrastructure, and secure every access path with least privilege.
lock_open
Unlock the full course
All 30 modules with detailed explanations, code examples, and exam tips.
Content Domain 1: Data Preparation for Machine Learning (ML) · 28%
An education platform is preparing an ML solution for ticket priority. An education platform stores 600 million events of curated tabular data in Amazon S3. Analysts commonly read a small subset of columns with Athena. Which format should the ML engineer choose?