AWS Certified Data Engineer Associate DEA-C01 Practice Question
A data engineering team needs to automate a three-step daily pipeline: run an AWS Glue crawler, launch a Glue Spark ETL job when the crawler succeeds, and then run a data-quality job only if the ETL job completes successfully. If any step fails, processing must stop and a message must be sent to the existing DataOps Amazon SNS topic. The team wants the simplest solution that avoids provisioning additional compute or workflow services outside of AWS Glue. Which approach meets these requirements?
Build an AWS Step Functions Standard workflow that invokes the crawler and Glue jobs with Catch clauses for failures and an SNS integration for notifications.
Create an AWS Glue workflow that links the crawler, ETL job, and data-quality job with on-success triggers, and add an EventBridge rule that forwards Glue Job State ChangeFAILED events to the DataOps SNS topic.
Configure three separate Glue time-based triggers; after each run, invoke an AWS Lambda function that checks the previous job status, starts the next job, and publishes failures to SNS.
Author a DAG in Amazon MWAA that submits the crawler and Glue jobs through the Spark operator and pushes unsuccessful task callbacks to the SNS topic.
AWS Glue workflows allow crawlers and jobs to be added as nodes that are started by on-completion triggers, so the crawler can trigger the ETL job and the ETL job can trigger the data-quality job. Failure of any node prevents downstream nodes from running. Glue publishes Job State Change and Workflow Run State Change events to Amazon EventBridge, where a rule can forward failed status events to an SNS topic without building extra infrastructure. Step Functions or MWAA can orchestrate the jobs, but they introduce additional services to build and maintain, contrary to the stated requirement. Chaining independent triggers with a custom Lambda loop also adds unnecessary operational overhead.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is an AWS Glue Workflow, and why is it used here?
Open an interactive chat with Bash
What are EventBridge Job State Change events, and how do they work with SNS in this solution?
Open an interactive chat with Bash
Why are Step Functions and MWAA considered less suitable for this scenario?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Ingestion and Transformation
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .