AWS Certified AI Practitioner AIF-C01 Practice Question
A developer is calling a large language model through Amazon Bedrock. The responses are useful but far longer than the application's chat window can display. Which inference parameter should the developer reduce to directly limit the length of each response?
Add additional stop sequences, such as common punctuation marks.
Decrease the temperature value used during sampling.
Reduce the Top-P (nucleus sampling) value.
Lower the maximum number of output tokens the model is allowed to generate.
The maximum output-token (maxTokens) setting places a hard cap on how many tokens the model may generate, so lowering this value shortens responses. Temperature and Top-P influence randomness and creativity, not length. Adding extra stop sequences can stop generation only when one of the sequences is produced; it is less direct and may not activate, so it is not the most reliable way to control verbosity.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is a token in the context of large language models?
Open an interactive chat with Bash
How does the maxTokens parameter affect model responses?
Open an interactive chat with Bash
What is the role of Temperature and Top-P in language models?
Open an interactive chat with Bash
What is a token in the context of large language models?
Open an interactive chat with Bash
How does the maxTokens parameter influence model outputs?
Open an interactive chat with Bash
What is the role of temperature in large language models?
Open an interactive chat with Bash
AWS Certified AI Practitioner AIF-C01
Applications of Foundation Models
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .