AWS Certified Data Engineer Associate DEA-C01 Practice Question
A data engineering team runs an AWS Glue Spark job that reads raw data from Amazon S3, applies transformations, and writes the output back to S3. The team must capture all driver, executor, and custom application logs, keep them searchable for 30 days, and minimize the operational effort required to manage the logging solution. Which approach best meets these requirements?
Turn on AWS CloudTrail data events for the source and target S3 buckets and query the resulting logs with Amazon Athena.
Enable execution logging for the AWS Glue job so that all stdout and stderr output is sent to an Amazon CloudWatch Logs group, configure a 30-day retention policy on the group, and use CloudWatch Logs Insights for log searches.
Stream AWS Glue logs through Amazon Kinesis Data Streams into an Amazon OpenSearch Service domain that rolls over indices every 30 days.
Modify the job script to write log files to a separate S3 bucket and schedule a daily Athena query to analyze the logs.
AWS Glue automatically streams driver and executor logs, as well as anything written to stdout or stderr in the job script, to an Amazon CloudWatch Logs group when logging is enabled. Setting the log group's retention policy to 30 days satisfies the required retention period without additional storage management. CloudWatch Logs Insights can be used immediately to search or filter the structured log events. The other options either capture the wrong type of data (CloudTrail), require custom ingestion code and delayed querying (writing logs to S3 for Athena), or introduce unnecessary infrastructure and administration (Kinesis Data Streams and Amazon OpenSearch Service).
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is AWS Glue execution logging?
Open an interactive chat with Bash
How does CloudWatch Logs Insights help with log searches?
Open an interactive chat with Bash
Why is CloudTrail not suitable for AWS Glue logs in this use case?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Operations and Support
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .