AWS Certified Data Engineer Associate DEA-C01 Practice Question

A data engineering team needs to orchestrate a daily ETL workflow. When a new file is uploaded to an Amazon S3 bucket, the workflow must start a long-running AWS Glue job that usually finishes in 2 hours. After the job completes, the workflow must publish the job's metrics to Amazon CloudWatch and send an email by using Amazon SNS if the job failed. The team wants a fully managed, serverless solution with the lowest operational overhead and the lowest cost that can handle the 2-hour runtime. Which Step Functions design meets these requirements?

Use Amazon EventBridge to trigger the Glue job directly and configure a separate EventBridge rule to invoke SNS on a Glue job failure event.
Create a Standard workflow that starts the Glue job with a Lambda function and polls the job status every minute until completion, then invokes SNS and CloudWatch.
Create an Express workflow that invokes the Glue job with the .sync integration pattern, then uses a Choice state to publish to SNS and CloudWatch.
Create a Standard workflow that uses the Glue StartJobRun .sync service integration, followed by a Choice state that publishes an SNS message on failure and a Task state that writes metrics to CloudWatch.

Report Issue

Answer Description

Because the ETL job can run for 2 hours, the workflow type must support long-running executions. Express workflows are cost-optimized but are limited to 5-minute execution durations, so they cannot be used. A Standard workflow supports executions up to 1 year, incurs charges only for the number of state transitions, and requires no infrastructure management. Using the native Glue StartJobRun service integration with the .sync integration pattern lets Step Functions wait for the job to finish without custom polling. After that, a Choice state can route to an SNS Publish task only if the job failed, and another Task state can send the metrics to CloudWatch. Polling the job status with Lambda or replacing the workflow with EventBridge rules would add cost or operational complexity and would not leverage Step Functions' built-in service integrations.

Ask Bash

Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.