AWS Certified Data Engineer Associate DEA-C01 Practice Question
An on-premises PostgreSQL table that grows to 500 GB is updated daily. The data engineering team must copy only the rows that were not loaded during the previous run into an Amazon S3 data lake every night. The solution must automatically handle new columns added to the source table and require the least ongoing maintenance. Which approach meets these requirements?
Schedule an AWS Glue crawler to crawl the PostgreSQL database nightly, then use an EventBridge rule to export the entire table with the psql utility to S3 and repartition the data with an EMR cluster.
Use AWS DMS in full-load plus CDC mode to replicate the table to S3, stopping and restarting the task each night, and catalog the files with AWS Glue.
Trigger a Lambda function with EventBridge that queries rows newer than the previous day and writes them to S3 as CSV files, updating the function code whenever the source schema changes.
Create an AWS Glue job that reads the PostgreSQL table through a Glue JDBC connection, enable job bookmarks with the last_updated column as the bookmark key, and write the dynamic frame to S3 in Parquet format.
Create an AWS Glue ETL job that connects to PostgreSQL through a Glue JDBC connection and reads the table as a dynamic frame. Configure job bookmarks with the last_updated column as the bookmark key so Glue tracks which rows have already been processed and loads only new data on subsequent runs. Dynamic frames are self-describing, so added columns are included automatically when the job runs again. The other options either reload the entire table, require manual code changes for schema updates, or add unnecessary operational overhead.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is AWS Glue and how does it help automate data processing?
Open an interactive chat with Bash
What are job bookmarks in AWS Glue and how do they work?
Open an interactive chat with Bash
What are dynamic frames in AWS Glue and why are they useful?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Ingestion and Transformation
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .