AWS Certified Data Engineer Associate DEA-C01 Practice Question
An AWS Glue ETL job runs every hour and streams its driver and executor output to the default Amazon CloudWatch Logs log group that is created for the job name. The operations team must receive an Amazon SNS notification whenever any log line contains the text "FATAL". The solution must require no changes to the ETL code and should be as simple as possible. Which approach meets these requirements?
Redirect Glue job logs to Amazon S3, schedule an Amazon Athena query that searches the files for "FATAL", and use Amazon EventBridge to invoke an SNS topic when the query returns results.
Enable CloudWatch Contributor Insights for the log group and define a rule that detects the string "FATAL"; create an alarm on the Contributor Insights rule and notify SNS.
Create a CloudWatch Logs metric filter on the job's log group that searches for the text "FATAL", then attach a CloudWatch alarm to that metric with an SNS action.
Configure a CloudWatch Logs subscription filter that streams all log events to an AWS Lambda function; have the function look for "FATAL" and publish a custom CloudWatch metric that an alarm monitors.
CloudWatch Logs metric filters can scan incoming log events for a literal text string or a JSON pattern and create a custom metric each time the pattern is found. After the metric filter is in place, a CloudWatch alarm can be configured on that metric with an SNS action so that every occurrence of the word "FATAL" triggers a notification. No changes to the AWS Glue job are required because the filtering and alarming occur entirely within CloudWatch Logs.
A subscription filter with Lambda could also detect the string, but it adds custom code and an extra service. CloudWatch Contributor Insights does not provide simple pattern matching on arbitrary strings, and exporting logs to Amazon S3 for Athena queries adds unnecessary complexity and delay, violating the real-time requirement.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is a CloudWatch Logs metric filter?
Open an interactive chat with Bash
How does CloudWatch Alarms integrate with SNS for notifications?
Open an interactive chat with Bash
Why is CloudWatch Logs metric filtering more efficient in this scenario than other methods like Lambda or Athena?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Operations and Support
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99 $11.99
$11.99/mo
Billed monthly, Cancel any time.
$19.99 after promotion ends
3 Month Pass
$44.99 $26.99
$8.99/mo
One time purchase of $26.99, Does not auto-renew.
$44.99 after promotion ends
Save $18!
MOST POPULAR
Annual Pass
$119.99 $71.99
$5.99/mo
One time purchase of $71.99, Does not auto-renew.
$119.99 after promotion ends
Save $48!
BEST DEAL
Lifetime Pass
$189.99 $113.99
One time purchase, Good for life.
Save $76!
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .