AWS Certified Data Engineer Associate DEA-C01 Practice Question
A company needs to ingest JSON payloads from a third-party REST API that requires OAuth 2.0 authentication. The data must be fetched every 15 minutes, converted to Parquet, and stored in an Amazon S3 data lake with minimal custom code. Which solution will meet these requirements while following AWS best practices?
Configure an Amazon AppFlow flow with a custom connector to the REST API and schedule the flow to place Parquet files in Amazon S3.
Create an AWS DataSync task that authenticates to the REST API and transfers the data to an S3 location every 15 minutes.
Create an AWS Glue connection that uses the AWS Glue REST API connector, then schedule a Glue ETL job to call the API, convert the results to Parquet, and write to Amazon S3.
Set up an Amazon Kinesis Data Firehose delivery stream that pulls from the REST endpoint and delivers data as Parquet to Amazon S3.
An AWS Glue custom connector for REST APIs natively handles OAuth 2.0 authentication, pagination, and retry logic. You can create a Glue connection that uses the connector, build a Glue ETL job to read the API response, convert the DynamicFrame to Parquet, and write to Amazon S3. A Glue schedule (or an EventBridge rule that triggers the job) reliably runs the ingestion every 15 minutes without the need to maintain servers or custom retry code.
Amazon AppFlow does not provide a generic REST connector. Kinesis Data Firehose and AWS DataSync cannot pull data from external REST APIs, so they cannot meet the requirement without additional custom components.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is OAuth 2.0 authentication and how does it work in AWS Glue?
Open an interactive chat with Bash
What are the advantages of using AWS Glue for this solution?
Open an interactive chat with Bash
Why can't Amazon AppFlow, Kinesis Data Firehose, or DataSync be used for this requirement?
Open an interactive chat with Bash
AWS Certified Data Engineer Associate DEA-C01
Data Ingestion and Transformation
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99 $11.99
$11.99/mo
Billed monthly, Cancel any time.
$19.99 after promotion ends
3 Month Pass
$44.99 $26.99
$8.99/mo
One time purchase of $26.99, Does not auto-renew.
$44.99 after promotion ends
Save $18!
MOST POPULAR
Annual Pass
$119.99 $71.99
$5.99/mo
One time purchase of $71.99, Does not auto-renew.
$119.99 after promotion ends
Save $48!
BEST DEAL
Lifetime Pass
$189.99 $113.99
One time purchase, Good for life.
Save $76!
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .