AWS Certified Data Engineer Associate DEA-C01 Practice Question
An ETL application runs nightly in AWS Glue and occasionally triggers transient Amazon EMR clusters to pre-process raw data in Amazon S3. The security team must audit application logs for troubleshooting within 30 minutes of execution and retain them for 30 days. The solution should minimize operational overhead and cost while allowing SQL-like ad-hoc searches. Which approach best satisfies these requirements?
Stream AWS Glue and Amazon EMR job logs to Amazon CloudWatch Logs, enable CloudWatch Logs Insights for querying, and set each log group's retention policy to 30 days.
Store the job logs in an AWS CloudTrail Lake event data store with 30-day retention and query them using CloudTrail Lake query capabilities.
Deliver the logs to an Amazon S3 bucket through Amazon Kinesis Data Firehose, catalog them, and run ad-hoc queries with Amazon Athena; configure an S3 lifecycle rule to delete objects after 30 days.
Send the logs to an Amazon Redshift Serverless workgroup using Amazon Kinesis Data Streams and analyze them with Redshift Spectrum on demand.
Publishing the job logs for both AWS Glue and Amazon EMR directly to Amazon CloudWatch Logs provides near-real-time ingestion-typically within seconds-so the security team can inspect data well inside the 30-minute window. CloudWatch Logs Insights supports interactive, SQL-style queries without additional infrastructure, and a 30-day retention policy can be set on each log group with a few clicks or an API call.
Sending logs to Amazon S3 and querying with Athena requires additional orchestration (Firehose delivery, partitioning, and catalog updates) and introduces latency before the data becomes queryable. Streaming logs into Redshift Serverless or maintaining CloudTrail Lake for application logs adds higher cost and management overhead, and CloudTrail Lake is designed for API activity, not arbitrary application logs. Therefore, using CloudWatch Logs with Logs Insights is the most operationally efficient and cost-effective choice that meets all stated requirements.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is Amazon CloudWatch Logs?
Open an interactive chat with Bash
How does CloudWatch Logs Insights enable SQL-like queries?
Open an interactive chat with Bash
Why is Amazon CloudWatch more cost-effective compared to other solutions for operational log analysis?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Security and Governance
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .