AWS Certified Data Engineer Associate DEA-C01 Practice Question

Amazon Kinesis Data Streams is designed for high-throughput, low-latency streaming ingestion. Each shard supports up to 1 MB/s or 1,000 records per second, and records are typically readable by consumers in less than one second. Provisioning 20 shards therefore supplies 20 MB/s of write capacity while meeting the sub-second availability goal.

Amazon Data Firehose (formerly Kinesis Data Firehose) adds a delivery buffer-300 s by default for S3 and 0-60 s for most other destinations. Even with the new zero-buffering mode, AWS states that most deliveries occur within about five seconds, so it cannot guarantee availability within a few hundred milliseconds. Writing individual objects directly to Amazon S3 and reacting with S3 event notifications typically introduces seconds or longer of lag because notifications are usually delivered in seconds and can occasionally take a minute or more. Amazon EventBridge charges $1 per million events, has default PutEvents rate limits of 600-10,000 TPS (Region-dependent), and therefore costs significantly more than a provisioned Kinesis stream sized for this workload. For these reasons, a properly sized Kinesis Data Streams solution is the most cost-effective way to meet both throughput and latency requirements.