Crucial Exams

AWS Certified Data Engineer Associate DEA-C01 Practice Question

A company must ingest 500 GB of nightly CSV files that external partners upload by using SFTP. The files need to land directly in the company's Amazon S3-based data lake and automatically trigger an AWS Glue ETL workflow. The solution must avoid server administration and use a managed service for partner credentials. What should the data engineer do to meet these requirements?

  • Create AWS DataSync tasks that periodically pull files from each partner's SFTP server into the S3 data lake and set the task to invoke the AWS Glue workflow after completion.

  • Deploy an Auto Scaling group of EC2 instances running an SFTP service that writes uploads to attached EBS volumes, then use a scheduled script to copy the files to S3, and manually manage partner keys on the instances.

  • Provision an AWS Transfer Family SFTP server using the S3 bucket as its data store. For each partner, create a user with an SSH public key for authentication and an IAM role for S3 access. Configure an S3 event notification to start the AWS Glue workflow.

  • Require partners to install the Amazon Kinesis Agent to stream their files to an Amazon Kinesis Data Stream, then use an AWS Lambda function to write the stream data to S3 and trigger the AWS Glue workflow.

AWS Certified Data Engineer Associate DEA-C01
Data Store Management
Your Score:
Settings & Objectives
Random Mixed
Questions are selected randomly from all chosen topics, with a preference for those you haven’t seen before. You may see several questions from the same objective or domain in a row.
Rotate by Objective
Questions cycle through each objective or domain in turn, helping you avoid long streaks of questions from the same area. You may see some repeat questions, but the distribution will be more balanced across topics.

Check or uncheck an objective to set which questions you will receive.

Wipe Score
Bash, the Crucial Exams Chat Bot
AI Bot