AWS Certified Data Engineer Associate DEA-C01 Practice Question
A telecom company uploads 10 MB compressed log files every minute from 50 network devices to a dedicated Amazon S3 prefix. The data engineering team wants each file to be processed automatically as soon as it lands, and they must occasionally rerun the pipeline on an entire previous day when the transformation logic changes. Which data ingestion pattern best meets these requirements while minimizing operational overhead?
Low-latency streaming ingestion using Amazon Kinesis Data Streams
Stateless request/response ingestion through a synchronous REST API
Scheduled hourly batch ingestion that scans the prefix for new files
Event-driven micro-batch ingestion from S3 that triggers processing for each new object and supports backfill from stored files
An event-driven micro-batch pattern processes each file immediately after it is written to Amazon S3, using features such as S3 event notifications to trigger downstream jobs. Because the raw files remain in S3, the team can replay or backfill any historical period simply by re-invoking the processing jobs on the stored objects. Scheduled batch ingestion introduces unnecessary latency, continuous streaming requires an always-on stream that the current S3-based workflow does not provide, and synchronous request/response ingestion is intended for transactional APIs rather than file-based analytics workloads.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is S3 event notification?
Open an interactive chat with Bash
What is meant by 'backfill' in a data pipeline context?
Open an interactive chat with Bash
Why is event-driven ingestion better for this use case than streaming with Amazon Kinesis?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Ingestion and Transformation
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99 $11.99
$11.99/mo
Billed monthly, Cancel any time.
$19.99 after promotion ends
3 Month Pass
$44.99 $26.99
$8.99/mo
One time purchase of $26.99, Does not auto-renew.
$44.99 after promotion ends
Save $18!
MOST POPULAR
Annual Pass
$119.99 $71.99
$5.99/mo
One time purchase of $71.99, Does not auto-renew.
$119.99 after promotion ends
Save $48!
BEST DEAL
Lifetime Pass
$189.99 $113.99
One time purchase, Good for life.
Save $76!
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .