Skip to main content

Azure AI Services Cheat Sheet

Azure AI services hierarchy

Azure AI Services Overview

Vision services

ServiceWhat it doesKey features
Azure AI VisionAnalyze images and videoImage Analysis, OCR, spatial analysis, image captioning
Face API (part of AI Vision)Detect and recognize facesFace detection, verification, identification, emotion (limited)
Custom VisionTrain custom image modelsImage classification, object detection with your own data

When to use which:

  • Need general image analysis? → Azure AI Vision
  • Need to train on your own images? → Custom Vision
  • Need to detect/verify faces? → Face API

Language services

ServiceWhat it doesKey features
Azure AI LanguageUnderstand and analyze textSentiment analysis, key phrase extraction, entity recognition, CLU, summarization, QnA
CLU (Conversational Language Understanding)Build intent + entity modelsReplaces LUIS; custom NLU for chatbots and apps
Azure AI TranslatorTranslate text between languages100+ languages, custom models, document translation
QnA (Question Answering)Build knowledge bases from FAQsPart of Azure AI Language; replaces QnA Maker

Speech services

ServiceWhat it doesKey features
Speech-to-TextConvert audio to textReal-time and batch transcription, custom models
Text-to-SpeechConvert text to audioNeural voices, custom voice, SSML support
Speech TranslationTranslate spoken language in real timeCombines recognition + translation
Speaker RecognitionIdentify/verify who is speakingVoice profiles, verification, identification

Document Intelligence

ServiceWhat it doesKey features
Azure AI Document IntelligenceExtract structured data from documentsPre-built models (invoices, receipts, ID), custom models, layout analysis

⚠️ Formerly called "Form Recognizer" — exam may reference either name.

Azure OpenAI Service

FeatureDetails
GPT modelsText generation, chat completion, summarization, code generation
DALL-EImage generation from text prompts
EmbeddingsVector representations for semantic search and RAG
WhisperAudio transcription model
AccessRequires application/approval; deployed via Azure OpenAI resource

Azure Machine Learning

ComponentPurpose
WorkspaceCentral hub for all ML assets (data, models, compute, experiments)
ComputeTraining clusters, compute instances, inference endpoints
DesignerDrag-and-drop ML pipeline builder (no code)
AutoMLAutomatically trains and tunes models from your data
PipelinesOrchestrate multi-step ML workflows
Model RegistryVersion and manage trained models
EndpointsDeploy models as REST APIs (real-time or batch)

Responsible AI — 6 principles

PrincipleDefinitionExample
FairnessAI treats all people equitablyLoan model doesn't discriminate by gender
Reliability & SafetyAI performs reliably under expected conditionsSelf-driving car handles edge cases safely
Privacy & SecurityAI respects privacy and is secureTraining data is anonymized and encrypted
InclusivenessAI empowers everyoneApp works for users with disabilities
TransparencyAI systems are understandableUsers know when they're interacting with AI
AccountabilityPeople are accountable for AI systemsHuman review process for high-stakes decisions

Key differences table

Old nameNew nameNotes
Cognitive ServicesAzure AI servicesUmbrella rebrand (2023)
Form RecognizerAzure AI Document IntelligenceSame capabilities, new name
LUISCLU (Azure AI Language)Conversational Language Understanding
QnA MakerQuestion Answering (Azure AI Language)Now part of Language service
Metrics AdvisorAzure AI Anomaly DetectorConsolidated
ComparisonWhen to use AWhen to use B
Custom Vision vs Azure AI VisionYou need to train on your own labeled imagesYou need general-purpose image analysis (out-of-the-box)
CLU vs Prebuilt Language featuresYou need custom intents/entities for your domainStandard tasks (sentiment, key phrases, NER) suffice
Azure ML vs Azure AI servicesYou need to build/train/deploy custom modelsYou need a pre-built API for a common AI task
Azure OpenAI vs Azure AI LanguageYou need generative text, chat, or codeYou need analytical NLP (sentiment, extraction)

ML concepts quick reference

TermMeaning
FeatureAn input variable used for prediction (e.g., age, income)
LabelThe value you're trying to predict (e.g., price, category)
TrainingFeeding data to an algorithm so it learns patterns
ValidationTesting the model on held-out data to measure accuracy
InferenceUsing a trained model to make predictions on new data
OverfittingModel memorizes training data; performs poorly on new data
UnderfittingModel is too simple; misses patterns in data