AWS Certified Data Engineer Associate DEA-C01 Practice Question
A data engineering team streams records with Amazon Kinesis Data Firehose into an S3 bucket. When each hourly object arrives, the team must start an AWS Glue Spark job to cleanse the data and then run a SQL MERGE in Amazon Redshift. The orchestration should offer built-in retries, send one Amazon SNS alert on any failure, and require the least custom code. Which solution meets these requirements?
Deploy an Amazon Managed Workflows for Apache Airflow (MWAA) environment and build a DAG that polls the S3 bucket hourly, triggers the Glue job, executes the Redshift merge with a JDBC operator, and sends an SNS alert from an Airflow callback.
Create an Amazon EventBridge ObjectCreated rule that starts an AWS Step Functions state machine. Use the Glue StartJobRun task, then an AWS SDK task to call the Redshift Data API ExecuteStatement. Add a Catch path that publishes to SNS on any error.
Attach the S3 bucket event to a Lambda function that starts the Glue job, loops on GetJobRun until completion, then connects to Redshift with psycopg2 to run the merge; configure CloudWatch Alarms to forward errors to SNS.
Create an AWS Glue workflow triggered by S3 Event Notifications, add the ETL job, and include a Python shell step that runs the Redshift SQL; configure the workflow to publish an SNS message on failure.
AWS Step Functions offers native service integrations. An EventBridge ObjectCreated rule can start a state machine that:
invokes the Glue StartJobRun API,
on success calls the Redshift Data API ExecuteStatement task to run the SQL merge,
uses a Catch block that routes all unhandled errors to an SNS Publish task. Step Functions includes configurable retry policies and requires only a declarative state-machine definition-no custom polling or exception-handling code. AWS Glue workflows cannot directly invoke Redshift, so extra code is needed. MWAA and Lambda solutions involve significantly more custom Python logic and operational overhead, violating the "least custom code" requirement.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is AWS Step Functions and how do they integrate with other AWS services?
Open an interactive chat with Bash
What is the Amazon EventBridge ObjectCreated rule and how does it trigger workflows?
Open an interactive chat with Bash
How does the Redshift Data API ExecuteStatement task help with running SQL queries?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Ingestion and Transformation
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .