Microsoft Azure AI Engineer Associate AI-102 Practice Question
You created a multi-step agent in Azure AI Studio by orchestrating a Semantic Kernel planner, several function skills, and Azure OpenAI. Before exposing the agent endpoint to business users, you must verify that every new version still answers a fixed set of 100 test prompts correctly, and you want an automated scorecard that includes groundedness and relevancy metrics after each run. Which Azure AI Studio capability should you use to meet these requirements with the least custom code?
Run an evaluation from the Evaluate tab, which uses Prompt Flow to score the agent against the test dataset
Export the conversation transcript after each manual session and compare it in Excel
Add additional instructions to the agent's system message to log groundedness scores
Test the agent manually in the playground chat panel and record the responses
Azure AI Studio includes a built-in evaluation feature that is accessed from the Evaluate tab. The feature re-uses the Prompt Flow evaluation engine; you can upload a dataset of test prompts, run the agent automatically, and generate a scorecard that calculates built-in metrics such as groundedness and relevancy. The playground chat panel and transcript download are interactive tools that do not produce automated regression results, while changing the system message does not provide any evaluation capabilities. Therefore, using the built-in evaluation run is the correct choice.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is Prompt Flow in Azure AI Studio?
Open an interactive chat with Bash
What is groundedness in Azure AI evaluation metrics?
Open an interactive chat with Bash
How does the Evaluate tab improve AI agent testing?
Open an interactive chat with Bash
Microsoft Azure AI Engineer Associate AI-102
Implement an agentic solution
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .