Microsoft Azure AI Engineer Associate AI-102 Practice Question
You built a custom agent with Azure AI Foundry Agent Service in Azure AI Studio. A JSONL file contains 200 user utterances, the expected agent replies, and grading labels. Before releasing the agent, you need to calculate precision, recall, and F1 and save the results so that future prompt versions can be compared. Which action should you take in Azure AI Studio?
Import the JSONL file as a knowledge base data source and trigger a bulk chat simulation.
Create and run an evaluation run against the agent deployment, supplying the JSONL conversation dataset.
Configure a traffic-splitting deployment slot and route 5 percent of users to the new agent version.
Enable session transcripts in Application Insights on the staging endpoint and manually review the logs.
Azure AI Studio provides an evaluation run feature for any deployed chat model or agent. By creating a new evaluation run, attaching the JSONL ground-truth file, and selecting the desired metrics, the service executes the agent for every utterance and automatically computes precision, recall, and F1. The results are stored with the run and can be compared with later evaluations. Enabling Application Insights only yields raw logs, importing the file as a knowledge source augments retrieval rather than evaluating, and traffic-splitting targets live canary tests rather than offline metric calculation.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is an evaluation run in Azure AI Studio?
Open an interactive chat with Bash
What are precision, recall, and F1 score, and why are they important in AI evaluation?
Open an interactive chat with Bash
What does a JSONL file look like, and how is it used in AI model evaluation?
Open an interactive chat with Bash
Microsoft Azure AI Engineer Associate AI-102
Implement an agentic solution
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .