AWS Certified Data Engineer Associate DEA-C01 Practice Question
A data engineering team needs to orchestrate a daily ETL workflow. When a new file is uploaded to an Amazon S3 bucket, the workflow must start a long-running AWS Glue job that usually finishes in 2 hours. After the job completes, the workflow must publish the job's metrics to Amazon CloudWatch and send an email by using Amazon SNS if the job failed. The team wants a fully managed, serverless solution with the lowest operational overhead and the lowest cost that can handle the 2-hour runtime. Which Step Functions design meets these requirements?
Create an Express workflow that invokes the Glue job with the .sync integration pattern, then uses a Choice state to publish to SNS and CloudWatch.
Create a Standard workflow that starts the Glue job with a Lambda function and polls the job status every minute until completion, then invokes SNS and CloudWatch.
Use Amazon EventBridge to trigger the Glue job directly and configure a separate EventBridge rule to invoke SNS on a Glue job failure event.
Create a Standard workflow that uses the Glue StartJobRun .sync service integration, followed by a Choice state that publishes an SNS message on failure and a Task state that writes metrics to CloudWatch.
Because the ETL job can run for 2 hours, the workflow type must support long-running executions. Express workflows are cost-optimized but are limited to 5-minute execution durations, so they cannot be used. A Standard workflow supports executions up to 1 year, incurs charges only for the number of state transitions, and requires no infrastructure management. Using the native Glue StartJobRun service integration with the .sync integration pattern lets Step Functions wait for the job to finish without custom polling. After that, a Choice state can route to an SNS Publish task only if the job failed, and another Task state can send the metrics to CloudWatch. Polling the job status with Lambda or replacing the workflow with EventBridge rules would add cost or operational complexity and would not leverage Step Functions' built-in service integrations.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is the '.sync' integration pattern in AWS Step Functions?
Open an interactive chat with Bash
Why are Standard workflows better than Express workflows for long-running tasks in Step Functions?
Open an interactive chat with Bash
What are the benefits of using Step Functions' built-in service integrations vs custom solutions like Lambda polling?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Ingestion and Transformation
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99 $11.99
$11.99/mo
Billed monthly, Cancel any time.
$19.99 after promotion ends
3 Month Pass
$44.99 $26.99
$8.99/mo
One time purchase of $26.99, Does not auto-renew.
$44.99 after promotion ends
Save $18!
MOST POPULAR
Annual Pass
$119.99 $71.99
$5.99/mo
One time purchase of $71.99, Does not auto-renew.
$119.99 after promotion ends
Save $48!
BEST DEAL
Lifetime Pass
$189.99 $113.99
One time purchase, Good for life.
Save $76!
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .