AWS Certified Data Engineer Associate DEA-C01 Practice Question

A company receives CSV files in an Amazon S3 bucket that is owned by another AWS account. A data engineer must copy any new files to the company's central data-lake bucket every hour between 08:00 and 18:00, Monday through Friday. The solution must be serverless, easy to adjust for future schedule changes, and incur the lowest possible operational cost. Which approach meets these requirements MOST effectively?

Create an Amazon EventBridge rule with a cron expression that invokes an AWS Lambda function every hour during business hours; the function assumes a cross-account role and copies any new objects to the data-lake bucket.
Launch an Amazon EC2 instance and configure a Linux cron job that runs the "aws s3 sync" command every hour to copy the objects between buckets.
Configure an hourly AWS Glue crawler on the source bucket and trigger an AWS Glue job to copy the files into the destination bucket.
Deploy Apache Airflow in Amazon Managed Workflows for Apache Airflow (MWAA) and create an hourly DAG that runs an AWS Data Pipeline task to replicate the files.

Report Issue

Answer Description

An Amazon EventBridge rule can use a cron expression to run on an exact hourly schedule limited to specific days and times. The rule invokes an AWS Lambda function, which is serverless and priced per request. The function can use an IAM role that has cross-account S3 permissions to list and copy only new objects. This pattern requires no provisioned infrastructure and schedule changes are made by simply updating the EventBridge rule.

Running Apache Airflow on Amazon MWAA introduces continuous environment costs and additional operational overhead. Maintaining an EC2 instance with a cron job violates the serverless constraint and adds management responsibilities. Scheduling an AWS Glue crawler and job is possible but is more expensive and unnecessary for a straightforward file copy operation, making it less cost-effective than the EventBridge-and-Lambda combination.

Ask Bash

Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.