GCP Professional Data Engineer Practice Question

Your company operates a shared-VPC architecture with a host project named prod-vpc. You must design a batch Dataflow pipeline that reads Parquet files from Cloud Storage and loads the results into a BigQuery dataset. Finance regulations state that the worker VMs may not have public IP addresses and that all traffic between the workers and Google APIs must stay on Google's private network. Which approach meets the requirements while adding the least operational overhead?

Run the Dataflow job with the --no_use_public_ips flag and specify a subnet in prod-vpc that has Private Google Access enabled; do not configure Cloud NAT or external IPs.
Create a Cloud NAT gateway in prod-vpc, run Dataflow workers without external IPs, and let the NAT gateway provide internet egress to Cloud Storage and BigQuery.
Replace the batch job with Cloud Functions that read from Cloud Storage and write to BigQuery, because Cloud Functions execute in a serverless environment without public IPs.
Provision a separate VPC in the data project, peer it with prod-vpc, run Dataflow in its default (public) mode, and restrict egress traffic using firewall rules that allow 0.0.0.0/0 only over HTTPS.

Report Issue

Answer Description

Running the pipeline in Dataflow's private IP mode satisfies both constraints with minimal extra components. By launching the job with the --subnetwork (or --network) parameter that points to a subnet in the shared VPC where Private Google Access is enabled, and adding the --no_use_public_ips flag, the worker VMs are created without external (public) IP addresses. Private Google Access lets these internal-only VMs reach Google APIs such as Cloud Storage and BigQuery over Google's private backbone, so no Cloud NAT, VPN, or additional interconnect is needed. The other options either leave the workers with public addresses, introduce NAT (which allocates public egress IPs), rely on Cloud Functions (which does not replace Dataflow batch processing and may still egress publicly), or add unnecessary separate VPCs and public routing-none of which meet both the security requirement and the goal of low operational overhead.

Ask Bash

Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.