GCP Professional Data Engineer Practice Question

An international media company needs to automate ingestion of two datasets into BigQuery: (1) daily cost reports coming directly from Google Ads and (2) nightly CSV files that an external partner drops into an Amazon S3 bucket. The solution must be fully managed, offer built-in scheduling with automatic retries, and require no custom pipeline development or separate orchestration layer. Which Google Cloud service should the data engineering team choose to meet these requirements?

Build ETL pipelines in Cloud Data Fusion for each source and orchestrate daily runs with Cloud Composer.
Set up Database Migration Service to continuously replicate data from Google Ads and Amazon S3 into BigQuery.
Configure BigQuery Data Transfer Service with separate transfer configurations for Google Ads and Amazon S3 to load data directly into BigQuery on a schedule.
Use Storage Transfer Service to copy the S3 files to Cloud Storage and trigger Cloud Functions that load both data sources into BigQuery.

Report Issue

Answer Description

BigQuery Data Transfer Service (DTS) offers native, fully managed connectors for both Google Ads and Amazon S3. Each data source can be configured as its own transfer, and DTS handles authentication, scheduling, monitoring, and automatic retry of failed runs while loading data directly into BigQuery. Storage Transfer Service copies objects into Cloud Storage only and would still need additional logic to load data into BigQuery. Cloud Data Fusion with Composer would meet the need but introduces extra infrastructure and pipeline maintenance. Database Migration Service focuses on transactional database replication and does not support SaaS or object-storage sources such as Google Ads or S3. Therefore, BigQuery DTS is the most appropriate choice.

Ask Bash

Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.