AWS Certified Data Engineer Associate DEA-C01 Practice Question

A data engineering team schedules an AWS Glue Spark job through Amazon EventBridge to transform and load daily CSV files from an S3 landing prefix into a partitioned analytics bucket. The job writes with append mode, and Athena reports sometimes reveal duplicate rows for the same day even though the source files are never modified. Which change will most effectively prevent these duplicates while keeping the pipeline fully automated and cost-effective?

  • Configure an S3 lifecycle rule to delete files in the landing prefix immediately after the job finishes.

  • Enable AWS Glue job bookmarks so the job automatically ignores files it has already processed.

  • Change the Spark write operation to overwrite the existing date partition each day.

  • Add an AWS Step Functions state machine that calls Athena to delete duplicate records after each load completes.

AWS Certified Data Engineer Associate DEA-C01
Data Operations and Support
Your Score:
Settings & Objectives
Random Mixed
Questions are selected randomly from all chosen topics, with a preference for those you haven’t seen before. You may see several questions from the same objective or domain in a row.
Rotate by Objective
Questions cycle through each objective or domain in turn, helping you avoid long streaks of questions from the same area. You may see some repeat questions, but the distribution will be more balanced across topics.

Check or uncheck an objective to set which questions you will receive.

Bash, the Crucial Exams Chat Bot
AI Bot