Microsoft AI-102 Exam Course: Designing and Implementing a Microsoft Azure AI Solution
Certification: Microsoft Certified: Azure AI Engineer Associate Exam: AI-102: Designing and Implementing a Microsoft Azure AI Solution Vendor: Microsoft Source used: The generated 1,008-row AI-102 scenario question bank, consolidated into original study notes. Official alignment note: Microsoft Learn lists AI-102 skills measured as of December 23, 2025. The exam and related certification retire June 30, 2026. Official study guide: https://learn.microsoft.com/en-us/credentials/certifications/resources/study-guides/ai-102
1. Exam Overview
What the exam is testing
AI-102 tests whether you can design, build, deploy, secure, monitor, and integrate Azure AI solutions. The exam is not only about knowing service names. Most questions ask you to choose the best service, architecture, API, deployment model, or security approach for a business scenario.
You should be ready to reason about:
Selecting the right Microsoft Foundry / Azure AI service for a requirement.
Building generative AI solutions with models, prompts, retrieval, evaluation, safety, and deployment.
Creating agentic solutions that use tools, grounding data, workflows, and guardrails.
The exam usually hides the answer in the requirement wording. Look for these clues:
Requirement clue
What it usually means
โUse one endpoint and key for multiple AI servicesโ
Multi-service Azure AI services resource
โLeast privilege, avoid keysโ
Managed identity + RBAC
โPrivate network onlyโ
Private endpoint, VNet integration, disable public network access where supported
โExtract fields from invoices/receipts/contracts/formsโ
Azure AI Document Intelligence or Content Understanding, not generic OCR alone
โSearch across documents with semantic/vector retrievalโ
Azure AI Search with vector index, semantic ranking, skillsets where needed
โGround model answers on enterprise dataโ
RAG with Azure AI Search or another retrieval layer
โGenerate or evaluate prompts/workflowsโ
Microsoft Foundry tooling, prompt flow, evaluation, content safety
โSpeech to text / text to speech / translationโ
Azure AI Speech / Translator / Language depending on input and output
โModerate harmful text/imagesโ
Azure AI Content Safety
โNamed entities, key phrases, sentiment, PIIโ
Azure AI Language
How to use this course
Read the domain overview first.
Study each domain by service-selection logic, not by memorizing isolated facts.
Use the tables to eliminate wrong answers quickly.
Review the traps section before practicing questions.
Use the final checklist as the last-day exam review.
2. Exam Domains
The official AI-102 domains are organized as follows. The CSV question bank was generated to match these priorities and then consolidated into this course.
Domain
Official priority
Rows in source CSV
Source share
What matters most
Plan and manage an Azure AI solution
20โ25%
230
22.8%
Service selection, deployment, security, Responsible AI, monitoring, CI/CD
Implement generative AI solutions
15โ20%
180
17.9%
Foundry, model deployment, prompts, RAG, grounding, evaluation, content safety
Azure AI Search indexing vs direct database query.
RAG vs fine-tuning vs prompt engineering.
Semantic search vs vector search vs hybrid search.
Single-service resource vs multi-service resource.
API key vs managed identity.
Public endpoint vs private endpoint.
Batch ingestion vs real-time inference.
Model evaluation vs application monitoring.
Final review phase
Before exam day, focus on:
Service selection tables.
Domain traps.
RAG architecture steps.
Azure AI Search indexing pipeline.
Document extraction pipeline.
Security and Responsible AI controls.
Prompt evaluation and content safety.
Difference between Language, Speech, Translator, Vision, Search, and Document Intelligence.
4. Core Concepts by Domain
Domain 1: Plan and manage an Azure AI solution
Concepts
This domain tests whether you can design and operate Azure AI solutions safely and correctly. It is not limited to provisioning resources. It includes choosing services, configuring deployment options, securing access, applying Responsible AI principles, monitoring, and integrating AI services into DevOps workflows.
Key concepts:
Selecting Microsoft Foundry Services based on task type.
Creating Azure AI resources and choosing single-service vs multi-service resources.
Choosing model deployment options and default endpoints.
Installing and using SDKs and REST APIs.
Securing secrets with Key Vault.
Using managed identities instead of hardcoded keys.
Applying RBAC and least privilege.
Configuring private endpoints and network restrictions.
Monitoring usage, latency, errors, quotas, and content safety events.
You need per-service isolation, separate billing, or a service not supported by the multi-service resource
Single-service resource
Strong isolation, service-specific settings, separate quotas
The scenario requires one shared endpoint/key for many services
Managed identity
Keyless authentication to Azure resources
The target service does not support Entra ID/RBAC for that action
Key Vault
Store API keys, connection strings, secrets, certificates
Do not store secrets in app settings, source code, or notebooks
Private endpoint
Private network access to AI services
Public internet access is acceptable and simpler requirements are stated
Azure Monitor / Log Analytics
Metrics, logs, diagnostics, alerting
Do not use only application logs when platform metrics are required
Content Safety
Moderation and safety filters for user/model content
It does not replace identity, authorization, or network security
Patterns
Pattern: secure AI app integration
Recommended architecture:
Application uses managed identity.
Managed identity is granted minimum required RBAC role.
Secrets are stored in Key Vault only when keys are unavoidable.
AI service access is restricted with private endpoint if required.
Diagnostics are sent to Log Analytics.
Content Safety is applied where user-generated or model-generated content is involved.
Why wrong answers fail:
API keys in code are fast but insecure.
Storage account alone does not protect AI service calls.
Public endpoint with unrestricted keys fails private/compliance requirements.
Pattern: containerized AI service
Use containers when:
You need edge processing or low latency near data.
Connectivity is intermittent but billing/licensing requirements can still be met.
The selected service supports containers.
Trap: containers do not eliminate billing, licensing, connectivity, or service-specific limitations.
Traps
Choosing Azure Machine Learning when the scenario only needs a prebuilt AI API.
Choosing a multi-service resource when strict isolation or unsupported service features are required.
Choosing API keys when the requirement says โno secretsโ or โleast privilege.โ
Assuming private endpoint automatically handles authorization; it only handles network path.
Confusing content moderation with security authorization.
Ignoring quotas, region availability, and model deployment constraints.
Domain 2: Implement generative AI solutions
Concepts
This domain tests your ability to build generative AI applications using Microsoft Foundry tooling, deployed models, prompt design, RAG, evaluation, and safety controls.
You must know:
Model selection and deployment.
Prompt engineering and system messages.
Grounding with enterprise data.
Retrieval-augmented generation.
Embeddings and vector search.
Prompt flow / orchestration patterns.
Evaluation of generated outputs.
Content safety and responsible AI guardrails.
Monitoring, cost, latency, and token usage.
Services
Capability
Best-fit service or pattern
Why
Chatbot over enterprise documents
Azure OpenAI/model deployment + Azure AI Search RAG
Keeps answers grounded in current internal content
Semantic/vector retrieval
Azure AI Search vector index
Enables similarity search over embeddings
Harmful content detection
Azure AI Content Safety
Detects unsafe user or model-generated content
Prompt workflow testing
Microsoft Foundry prompt flow/evaluation
Supports iterative prompt development and evaluation
Generate embeddings
Embedding model deployment
Converts text into vectors for retrieval
Need exact source citations
RAG with retrieved passages and metadata
Model alone cannot guarantee source grounding
Patterns
Pattern: RAG application
Use RAG when the question says:
โAnswers must use company documents.โ
โInformation changes frequently.โ
โCitations are required.โ
โDo not retrain the model.โ
โUse private knowledge base.โ
Typical RAG flow:
Ingest documents into storage.
Chunk documents into meaningful sections.
Generate embeddings for chunks.
Store chunks, metadata, and vectors in Azure AI Search.
At query time, embed the user query.
Retrieve relevant chunks with vector, semantic, or hybrid search.
Pass retrieved context to the model.
Generate grounded answer with citations.
Apply content safety and logging.
Evaluate answer quality and retrieval quality.
Pattern: prompt safety and evaluation
Use:
System message to define role, boundaries, format, and refusal behavior.
Grounding data to reduce hallucination.
Content Safety to detect harmful inputs/outputs.
Evaluation datasets to compare prompt versions.
Logging and monitoring to detect failures in production.
Traps
Fine-tuning when RAG is better for changing knowledge.
Prompt engineering alone when source grounding is required.
RAG without chunking and metadata, causing poor retrieval.
Vector search alone when keyword matching is also important; hybrid search may be better.
Storing secrets in prompt flow or code instead of Key Vault.
Ignoring content safety for user-generated inputs.
Assuming the model can access private documents without retrieval integration.
Domain 3: Implement an agentic solution
Concepts
Agentic solutions use a model plus instructions, tools, functions, memory/context, retrieval, and evaluation to perform multi-step tasks. AI-102 focuses on safe, grounded, tool-using agents rather than uncontrolled autonomous systems.
You should understand:
Agent instructions and system prompts.
Tool/function calling.
Grounding with Azure AI Search or enterprise APIs.
Planning and step execution.
Human approval for sensitive actions.
Guardrails and tool permission boundaries.
Evaluation of agent task success.
Logging tool calls and outputs.
Services and capabilities
Requirement
Best pattern
Agent answers based on internal documents
Agent + RAG over Azure AI Search
Agent performs actions in business systems
Tool/function calling with scoped permissions
Agent must not execute destructive actions automatically
Human-in-the-loop approval
Agent must follow a specific workflow
Orchestrated prompt flow or explicit tool sequence
Agent outputs must be checked for harmful content
Content Safety and policy filters
Agent must be evaluated before production
Task-based evaluation with expected outputs and traces
Patterns
Pattern: safe tool-using agent
Define agent role and boundaries.
Register only required tools.
Give each tool minimal permissions.
Validate tool inputs and outputs.
Require approval for irreversible actions.
Use retrieval for factual grounding.
Log reasoning traces, tool calls, and final outputs where supported.
Evaluate with realistic task scenarios.
Traps
Giving an agent broad credentials when only read access is required.
Letting an agent write/delete/update records without approval.
Treating an agent like a simple chatbot when the scenario requires tool calls.
Using a generic model answer when the agent must call an API.
Ignoring retrieval quality; a smart agent with poor grounding still fails.
Failing to monitor tool-call errors and unsafe outputs.
Domain 4: Implement computer vision solutions
Concepts
This domain tests image and visual content processing. Focus on choosing between OCR, image analysis, custom vision scenarios, face capabilities, and document extraction services.
OCR: extract printed/handwritten text from images.
Document extraction: use Document Intelligence for structured forms/documents.
Custom image classification/object detection: train custom models where supported.
Face capabilities: identity/sensitive use cases require careful Responsible AI and service restrictions.
Batch vs real-time image processing.
Containers for edge vision where supported.
Services
Scenario
Use
Avoid
Read text from a simple image
Azure AI Vision OCR
Full Document Intelligence unless structured fields/forms are required
Extract invoice fields like vendor, total, date
Azure AI Document Intelligence prebuilt invoice model
Generic OCR only
Generate image tags/captions
Azure AI Vision image analysis
Azure AI Language
Detect harmful images
Azure AI Content Safety
Azure AI Vision alone
Custom image classifier/object detector
Custom vision/model option where current service supports it
Generic image analysis if custom labels are needed
Analyze ID/document with structured fields
Document Intelligence
Vision OCR only
Patterns
Pattern: simple OCR vs structured document extraction
If the scenario only asks for text extraction from an image, OCR is enough.
If the scenario asks for fields, tables, key-value pairs, layout, invoices, receipts, contracts, or forms, use Document Intelligence.
Pattern: image moderation
Image analysis identifies objects/tags/captions.
Content Safety assesses harmful or unsafe content.
For user uploads, moderation often happens before storage, indexing, or model processing.
Traps
Choosing OCR for invoice field extraction.
Choosing Document Intelligence when the scenario only needs image tags.
Choosing Language service for image analysis.
Ignoring Responsible AI restrictions in face-related scenarios.
Assuming every Vision capability is available in every region or deployment mode.
Domain 5: Implement natural language processing solutions
Concepts
This domain covers text and speech understanding. The biggest exam skill is selecting the correct service for the input/output type.
You need to know:
Sentiment analysis and opinion mining.
Key phrase extraction.
Named entity recognition.
PII detection and redaction.
Text summarization.
Language detection.
Custom text classification.
Conversational language understanding.
Question answering where applicable.
Speech-to-text and text-to-speech.
Translation and document translation.
Services
Scenario
Best service
Detect sentiment in customer reviews
Azure AI Language sentiment analysis
Extract organizations, people, locations
Azure AI Language named entity recognition
Detect and redact personal data
Azure AI Language PII detection
Extract key phrases from text
Azure AI Language key phrase extraction
Classify support tickets by custom labels
Azure AI Language custom text classification
Understand user intent in a bot
Conversational language understanding
Convert audio to text
Azure AI Speech speech-to-text
Convert text to natural voice
Azure AI Speech text-to-speech
Translate text between languages
Azure AI Translator
Translate audio conversations
Speech translation, not text-only Translator
Patterns
Pattern: support-ticket routing
Use Azure AI Language custom text classification when:
The input is text.
You need labels such as Billing, Technical Support, Cancellation, Complaint.
You have training examples for custom classes.
Use conversational language understanding when:
You need to detect intents and entities from interactive user utterances.
The input is part of a bot or conversation.
Pattern: compliance redaction
Use Language PII detection when:
You need to find names, emails, phone numbers, addresses, government IDs, or other personal data.
You need redaction before storage, logging, or downstream model calls.
Traps
Choosing Translator when the requirement is sentiment or PII detection.
Choosing Speech for text-only translation.
Choosing Language when the input is audio and no transcription has occurred.
Choosing generic generative AI for deterministic PII detection when a dedicated Language capability exists.
Confusing entity extraction with key phrase extraction.
Confusing text classification with conversational intent recognition.
Domain 6: Implement knowledge mining and information extraction solutions
Concepts
This domain is heavily tested because it combines search, enrichment, document extraction, indexing, and retrieval for generative AI. You must understand how content becomes searchable and how structured data is extracted from unstructured sources.
Azure AI Search retrieves trusted document chunks.
Embeddings enable semantic similarity.
The model generates grounded answers.
Content Safety checks harmful inputs/outputs.
Managed identity avoids hardcoded keys.
Wrong alternatives:
Fine-tuning alone: does not keep current documents fresh.
Prompt only: cannot access private data.
Document Intelligence only: extracts content but does not provide full chatbot retrieval and generation.
Scenario 2: Invoice processing workflow
Recommended solution: Document Intelligence prebuilt invoice model or custom model, then store extracted fields and optionally index results.
Why:
Invoices require structured extraction: vendor, date, total, line items, tax.
OCR alone gives text, not reliable field mapping.
Azure AI Search can index extracted results but is not the extraction model.
Scenario 3: Secure banking chatbot
Recommended solution: private endpoint, managed identity, Key Vault only for unavoidable secrets, Content Safety, audit logs, PII detection/redaction where needed, and RAG over approved sources.
Wrong alternatives:
Public endpoint with unrestricted API key.
Logs containing raw PII.
Sending unredacted sensitive data to downstream services without controls.
Scenario 4: Customer support ticket automation
Recommended solution: Azure AI Language for classification, sentiment, PII detection; optionally generative AI for response drafting; human approval before sending sensitive responses.
Wrong alternatives:
Translator if no translation is needed.
Speech if the input is text.
Generative AI alone for compliance-grade PII detection.
Scenario 5: Knowledge mining from PDFs and scanned images
Recommended solution: Azure Blob Storage + Azure AI Search indexer + skillset with OCR/entity/key phrase skills + optional Document Intelligence + index fields designed for filters/facets + monitoring.
Wrong alternatives:
Search index without enrichment for scanned images.
Missing field attributes such as filterable/facetable.
Ignoring skillset output mappings.
Scenario 6: Agent that books appointments
Recommended solution: agent with clear instructions, calendar/tool APIs, least-privilege credentials, validation, human confirmation for booking/cancellation, and logs.
Wrong alternatives:
Chat model with no tools cannot actually book.
Agent with full admin rights violates least privilege.
No approval for destructive or external actions is risky.
7. Exam Traps
Misleading wording patterns
Wording
Trap
Correct thinking
โAI solutionโ
May tempt you to choose Azure ML
Use Azure AI services when prebuilt APIs satisfy the requirement
โSearch documentsโ
May tempt Document Intelligence
Search/ranking is Azure AI Search
โExtract invoice totalโ
May tempt OCR
Structured document fields need Document Intelligence
โTranslate spoken audioโ
May tempt Translator
Use Speech translation
โAnalyze image safetyโ
May tempt Vision
Use Content Safety for harmful content
โNo secrets in codeโ
May still show API key options
Use managed identity/RBAC where supported
โCurrent company policiesโ
May tempt fine-tuning
Use RAG because facts change
โPrivate accessโ
May tempt Key Vault only
Use private endpoint/network controls plus identity
Wrong-but-plausible answers
Azure Machine Learning appears as a distractor when a prebuilt Azure AI service is enough.
Azure Storage appears as a distractor for security or AI processing but is only storage.
API keys appear as easy integration choices but fail least-privilege/no-secret requirements.
OCR appears as a distractor for document understanding; use it only when raw text is enough.
Fine-tuning appears as a distractor for private knowledge; RAG is usually better.
Translator appears in speech scenarios; Speech is needed when audio is involved.
Azure AI Search appears for field extraction; it indexes and retrieves, it does not replace extraction models.
Elimination strategy
When stuck, ask:
What is the input format?
What exact output is required?
Does the scenario require extraction, search, generation, classification, or translation?
Does the answer satisfy security wording such as private, least privilege, or no secrets?
Does the solution use the simplest service that directly satisfies the requirement?
Does the data change frequently? If yes, prefer retrieval over fine-tuning.
Is the action risky? If yes, require guardrails and human approval.
An application must choose a default endpoint when using an Azure AI resource from SDK code. What information is generally required along with authentication?