An ecommerce retailer streams millions of click-event messages into Cloud Pub/Sub. The data engineering team wants to land the raw events in BigQuery as fast as possible, run complex SQL-based enrichments and aggregations inside BigQuery, and then write a daily inventory-forecast table from BigQuery into an external PostgreSQL database that supplies the merchandising application. They want to minimize pipeline code and avoid duplicating heavy transformations outside BigQuery. Which data-movement pattern best satisfies all of these requirements?
Apply an ELT pattern to ingest: stream raw events into BigQuery and transform them with SQL, then use a Reverse ETL pattern to write the resulting forecast table back to PostgreSQL.
Use a traditional ETL pipeline that transforms events in Dataflow before loading to BigQuery and also transforms the forecast table in Dataflow before inserting it into PostgreSQL.
Perform all transformations in Dataproc Spark jobs outside BigQuery, loading the pre-processed data into BigQuery and exporting the forecast to PostgreSQL via Cloud Storage files.
Implement a Reverse ETL pipeline for the click-event ingestion and use ELT to export the forecast table to PostgreSQL.
Loading raw events first and transforming them inside BigQuery follows the ELT approach: Extract from Pub/Sub, Load to BigQuery, and then Transform with BigQuery SQL. Pushing the curated inventory-forecast table from the warehouse back into an operational PostgreSQL system is the classic use case for Reverse ETL. Together, ELT for ingestion and Reverse ETL for operational publishing minimize code, keep heavy processing inside BigQuery, and avoid unnecessary copies. Pure ETL would move transformations outside BigQuery, while using Reverse ETL for ingestion or relying solely on ETL would violate the stated constraints.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is ELT, and how does it differ from ETL?
Open an interactive chat with Bash
What is Reverse ETL, and when is it used?
Open an interactive chat with Bash
Why is Cloud Pub/Sub used in the pipeline?
Open an interactive chat with Bash
What is Cloud Pub/Sub, and how does it work in data pipelines?
Open an interactive chat with Bash
What is ELT, and how does it differ from ETL in data processing?
Open an interactive chat with Bash
What is Reverse ETL, and what role does it play in data pipelines?
Open an interactive chat with Bash
What is ELT and how does it differ from ETL?
Open an interactive chat with Bash
What is Reverse ETL and how does it interact with ELT?
Open an interactive chat with Bash
What advantages does using BigQuery provide when implementing ELT?
Open an interactive chat with Bash
GCP Professional Data Engineer
Ingesting and processing the data
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99 $11.99
$11.99/mo
Billed monthly, Cancel any time.
$19.99 after promotion ends
3 Month Pass
$44.99 $26.99
$8.99/mo
One time purchase of $26.99, Does not auto-renew.
$44.99 after promotion ends
Save $18!
MOST POPULAR
Annual Pass
$119.99 $71.99
$5.99/mo
One time purchase of $71.99, Does not auto-renew.
$119.99 after promotion ends
Save $48!
BEST DEAL
Lifetime Pass
$189.99 $113.99
One time purchase, Good for life.
Save $76!
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .