AWS Certified Data Engineer Associate DEA-C01 Practice Question
An AWS Glue Spark job that extracts data from Amazon S3 and loads it into Amazon Redshift intermittently fails with Java heap-space errors. The data engineer must identify which Spark stages consume excessive executor memory without changing the job's code. What is the most effective way to obtain this information?
Set the job parameter --enable-bookmark true so Glue records incremental processing information.
Turn on the Glue job's Job metrics option and review the CloudWatch metrics that are published for each executor.
Increase the job's maximum DPUs and monitor whether the failures stop.
Enable autoscaling on the underlying EMR cluster that AWS Glue provisions for the job.
Enabling job metrics on the AWS Glue job causes the Glue service to push executor-level Spark metrics such as MemoryUsed and OldestRunningTaskAge to Amazon CloudWatch. The engineer can view these time-series metrics to determine the stages that spike memory and then tune executor sizing or code as needed. Merely adding DPUs may mask, not diagnose, the problem; EMR cluster autoscaling is irrelevant because Glue jobs run on a managed service; job bookmarks track processed data but do not expose memory statistics.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What are AWS Glue Job Metrics?
Open an interactive chat with Bash
How does Amazon CloudWatch help troubleshoot Glue job issues?
Open an interactive chat with Bash
Why is simply increasing DPUs not a reliable solution?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Operations and Support
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .