An e-commerce retailer stores all order data in an on-premises Oracle 12c database. Analysts need this data available in BigQuery for near-real-time reporting, while the engineering team wants every change captured in Cloud Storage for replay if pipelines fail. The solution must
stream new and updated rows within seconds,
avoid installing agents or creating excessive read locks on the source database, and
automatically propagate future schema changes to the cloud targets. Which Google Cloud service should you choose to implement the data movement with minimal operational overhead?
Database Migration Service with continuous replication from Oracle to Cloud SQL followed by federated queries from BigQuery.
Datastream, to stream Oracle change data capture records into Cloud Storage and automatically ingest them into BigQuery.
BigQuery Data Transfer Service configured with an Oracle connector to load tables on a daily schedule.
A custom Apache Beam pipeline on Dataflow that polls the Oracle database and writes results to BigQuery and Cloud Storage.
Datastream is Google Cloud's serverless change data capture (CDC) and replication service that connects to Oracle or MySQL sources without requiring agents on the database host. It streams insert, update, and delete events in near real time, writes them to Cloud Storage in Avro/JSON, and can automatically deliver the data into BigQuery while forwarding DDL statements to keep the destination schema in sync. Database Migration Service focuses on moving entire databases to Cloud SQL, not to BigQuery or Cloud Storage. BigQuery Data Transfer Service offers scheduled batch loads from SaaS apps or files, not CDC from Oracle. Building a custom Dataflow pipeline around Oracle redo logs would meet the requirements but imposes significant development and operational burden, conflicting with the "minimal operational overhead" constraint. Therefore, Datastream is the most suitable choice.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is Change Data Capture (CDC) and why is it important in data pipelines?
Open an interactive chat with Bash
Why is Datastream preferred for Oracle to BigQuery data movement over Database Migration Service?
Open an interactive chat with Bash
How does Datastream propagate schema changes from Oracle to cloud targets?
Open an interactive chat with Bash
What is Datastream in Google Cloud?
Open an interactive chat with Bash
What is Change Data Capture (CDC), and why is it important?
Open an interactive chat with Bash
How does Datastream handle schema changes in source databases?
Open an interactive chat with Bash
GCP Professional Data Engineer
Designing data processing systems
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .