AWS Certified Data Engineer Associate DEA-C01 Practice Question
A data engineer is writing a Python script that Jenkins will call after each hourly ingest. The script must start the AWS Glue job named csv_to_parquet, pass the S3 object path as a parameter, then block until the job finishes or fails so that Jenkins can act on the result. The engineer wants to minimise the number of AWS API calls and avoid writing custom polling logic. Which approach meets these requirements when using the AWS SDK for Python (boto3)?
Instantiate boto3.resource("glue").Job("csv_to_parquet").run(path=object_path); the run method blocks until the job finishes.
Call glue.start_job_run with the path argument, then repeatedly call glue.get_job_run every 5 seconds until the JobRunState is SUCCEEDED or FAILED.
Call glue.start_job_run, capture the JobRunId, then invoke glue.get_waiter("job_run_succeeded").wait(JobName="csv_to_parquet", RunId=job_id).
Call glue.start_job_run, capture the JobRunId, and poll the corresponding CloudWatch Logs stream until log events stop.
The AWS SDK for Python exposes a Glue waiter named job_run_succeeded. After calling start_job_run, the script can retrieve the JobRunId and invoke the waiter. The waiter handles periodic get_job_run calls internally, returning when the run reaches SUCCEEDED or raising a WaiterError if the run enters FAILED, STOPPED, or TIMEOUT. This satisfies the need to block until completion or failure while reducing explicit polling code and API calls. Manually looping over get_job_run would work but uses more calls and additional code. Querying CloudWatch Logs is unnecessary and still requires polling. boto3 does not provide a Glue resource interface that blocks until completion.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is a Glue waiter in boto3?
Open an interactive chat with Bash
How does the job_run_succeeded waiter reduce API calls?
Open an interactive chat with Bash
What is meant by the JobRunId, and why is it necessary?
Open an interactive chat with Bash
What is the purpose of AWS Glue waiters in boto3?
Open an interactive chat with Bash
How does glue.start_job_run differ from glue.get_waiter in boto3?
Open an interactive chat with Bash
Why is CloudWatch Logs polling unnecessary for monitoring AWS Glue jobs?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Operations and Support
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .