AWS Certified Data Engineer Associate DEA-C01 Practice Question
An analytics team stores daily JSON files in an Amazon S3 data lake using the prefix structure s3://sales-data/year=YYYY/month=MM/day=DD/. From time to time, the files include additional columns. The team wants Amazon Athena queries to recognize both the new date partitions and any new columns automatically, with minimal operational overhead. Which approach satisfies these requirements?
Schedule an AWS Glue crawler on the S3 prefix and enable it to update the table definition when schema changes are detected.
Use AWS Database Migration Service to replicate the files to S3 and export metadata to the Data Catalog.
Create the table manually in Athena, enable partition projection, and run MSCK REPAIR TABLE after each data load.
Run a nightly AWS Glue ETL job that issues ALTER TABLE ADD COLUMN statements and batchCreatePartition API calls.
An AWS Glue crawler can be pointed at the S3 prefix, scheduled to run after new files arrive, and configured to "Update the table definition and partition metadata" when a schema change is detected. This allows the crawler to add new partitions as well as merge newly discovered columns into the existing AWS Glue Data Catalog table, so Athena immediately sees the updated schema. Partition projection or MSCK REPAIR TABLE can add partitions but do not detect new columns. AWS DMS is unnecessary for files already in S3 and does not update the Data Catalog by itself. Writing a custom Glue ETL job to run ALTER TABLE and batchCreatePartition would meet the goal but introduces more maintenance than using the built-in crawler capability.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is an AWS Glue crawler?
Open an interactive chat with Bash
How does Amazon Athena interact with the AWS Glue Data Catalog?
Open an interactive chat with Bash
What are the limitations of using MSCK REPAIR TABLE in Athena?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Store Management
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .