AWS Certified Data Engineer Associate DEA-C01 Practice Question
An AWS Glue Data Catalog crawler must run every day at 01:00 UTC to catalog new objects in an Amazon S3 data lake. After the crawler succeeds, an AWS Glue ETL job must immediately transform the newly discovered partitions. The data engineering team wants to use only AWS Glue features, avoid additional services, and ensure the job always waits for the crawler to finish. Which solution meets these requirements?
Define two Amazon EventBridge rules: one to run the crawler at 01:00 UTC and another set for 01:05 UTC to start the ETL job.
Build an AWS Step Functions state machine that runs the crawler followed by the ETL job, and trigger the state machine with an EventBridge rule at 01:00 UTC.
Set up a single AWS Glue job with a daily schedule at 01:00 UTC, enable job bookmarks, and call the crawler from inside the job script before performing transformations.
Create a scheduled AWS Glue trigger with a cron expression to start the crawler at 01:00 UTC, and create a conditional Glue trigger that fires when the crawler succeeds and launches the ETL job.
AWS Glue provides four trigger types: scheduled, conditional, on-demand, and event-based. A scheduled trigger can launch a crawler or job on a cron-based schedule. For example, the cron expression cron(0 1 * * ? *) runs every day at 01:00 UTC. A conditional trigger can start one or more crawlers or jobs after specified predecessors reach a designated state, such as a crawler's SUCCEEDED state. Creating a scheduled trigger that starts the crawler at 01:00 UTC and a conditional trigger that fires when the crawler succeeds and launches the ETL job keeps the solution entirely within AWS Glue and guarantees that the job never starts until the crawler completes.
Using EventBridge rules or Step Functions introduces additional services, violating the constraint. Scheduling only the job and invoking the crawler from within the job is unreliable because the crawler runs asynchronously and the job cannot natively block until the crawl finishes.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is the difference between a scheduled and conditional AWS Glue trigger?
Open an interactive chat with Bash
How does AWS Glue ensure the ETL job waits for the crawler to finish?
Open an interactive chat with Bash
Why are EventBridge rules and Step Functions unsuitable for this solution?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Ingestion and Transformation
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .