AWS Certified AI Practitioner AIF-C01 Practice Question
A team wants to add a domain-specific chatbot to its website. They can either pre-train a large language model from scratch or fine-tune an existing foundation model. From a cost perspective, which statement is MOST accurate?
Pre-training from scratch is cheaper than fine-tuning because the training data can be collected from the public domain at no cost.
Pre-training costs are lower than in-context learning because pre-training avoids ongoing inference charges.
Pre-training from scratch is typically the most expensive option because it needs massive datasets and compute resources, while fine-tuning a pre-trained model costs far less.
Both pre-training and fine-tuning cost roughly the same if the team rents GPUs on demand.
Pre-training a state-of-the-art large language model typically involves ingesting hundreds of billions to a few trillion tokens-tens of terabytes of cleaned text-and running for hundreds of thousands to millions of GPU-hours. Public estimates for models such as GPT-3, PaLM, or LLaMA place the compute bill in the multi-million-dollar range. Fine-tuning re-uses the pre-trained weights and adjusts only a subset of parameters on a much smaller dataset, so the required compute time and associated cloud charges are orders of magnitude lower. Therefore, fine-tuning is far less expensive than training from scratch. Statements claiming that pre-training is cheaper, roughly equivalent in price, or cheaper than in-context learning are incorrect.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is the difference between pre-training and fine-tuning a model?
Open an interactive chat with Bash
What are some examples of costs involved in pre-training large language models?
Open an interactive chat with Bash
Why is fine-tuning preferred for domain-specific applications?
Open an interactive chat with Bash
Why is pre-training from scratch so expensive?
Open an interactive chat with Bash
What is fine-tuning in the context of foundation models?
Open an interactive chat with Bash
How does fine-tuning compare to in-context learning in terms of cost?
Open an interactive chat with Bash
AWS Certified AI Practitioner AIF-C01
Applications of Foundation Models
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .