GCP Professional Data Engineer Practice Question

Your company is building a unified analytics platform on Google Cloud. Factory sensors publish billions of events every second via an MQTT broker, while ten years of compressed CSV telemetry is stored in Amazon S3. A single Dataflow pipeline must apply the same transformations to both the real-time stream and periodic back-fills, then write curated data to BigQuery. To minimize operational effort and ensure Dataflow performs all transformations, which managed Google Cloud services should you use to ingest the streaming and batch data, respectively?

  • Datastream to capture MQTT sensor messages and scheduled gsutil copy jobs on Compute Engine to pull the S3 archives.

  • Cloud Pub/Sub for the sensor stream and BigQuery Data Transfer Service to load the S3 archives directly into BigQuery.

  • Cloud Pub/Sub for the sensor stream and Storage Transfer Service to move the S3 archives into Cloud Storage for batch ingestion.

  • Cloud Data Fusion's real-time streaming source for sensors and Transfer Appliance to ingest the S3 archives.

GCP Professional Data Engineer
Ingesting and processing the data
Your Score:
Settings & Objectives
Random Mixed
Questions are selected randomly from all chosen topics, with a preference for those you haven’t seen before. You may see several questions from the same objective or domain in a row.
Rotate by Objective
Questions cycle through each objective or domain in turn, helping you avoid long streaks of questions from the same area. You may see some repeat questions, but the distribution will be more balanced across topics.

Check or uncheck an objective to set which questions you will receive.

Bash, the Crucial Exams Chat Bot
AI Bot