Your gaming company operates data centers in North America, Europe, and Asia. Each region generates millions of in-game financial transactions daily. You must design a nightly batch pipeline that extracts a point-in-time snapshot of the day's transactions and loads it into BigQuery for analytics. The operational database must offer global, externally consistent transactions and scale horizontally across regions without manual sharding. Which managed Google Cloud service is the most appropriate batch data source for this pipeline?
Cloud Storage bucket containing daily Avro exports of the transactions
A BigQuery table populated by streaming inserts during the day
A Cloud SQL for PostgreSQL instance configured for high availability
Cloud Spanner is Google Cloud's globally distributed, horizontally scalable relational database that offers external (strong) consistency across all replicas. A nightly export or a Dataflow batch job using SpannerIO can read a consistent snapshot of the day's transactions and stage or write them directly to BigQuery.
Cloud Storage is an object store; while it is an excellent landing zone for exported data, it is not a transactional source. Cloud SQL provides managed MySQL, PostgreSQL, and SQL Server but is confined to a single region and scales vertically, so it cannot meet the global consistency and horizontal scalability requirements. BigQuery is an analytics warehouse rather than a transactional system and does not provide row-level transactional guarantees needed by the operational workload. Therefore, Cloud Spanner is the only option that satisfies the stated consistency and scale requirements for the batch source.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What does 'externally consistent transactions' mean in Cloud Spanner?
Open an interactive chat with Bash
How does Cloud Spanner scale horizontally across regions?
Open an interactive chat with Bash
What is SpannerIO and how is it used in data pipelines?
Open an interactive chat with Bash
Why is Cloud Spanner suitable for globally consistent transactions?
Open an interactive chat with Bash
How does Dataflow work with SpannerIO to export data?
Open an interactive chat with Bash
Why is Cloud SQL not suitable for this use case?
Open an interactive chat with Bash
GCP Professional Data Engineer
Ingesting and processing the data
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .