Your company operates a private data center that stores 400 TB of historical sensor data in an on-premises Hadoop HDFS cluster. Leadership has approved a one-time migration of this archive into a Coldline Cloud Storage bucket for long-term retention and occasional analytics in BigQuery. The data center's dedicated internet connection is limited to 200 Mbps and must remain available for business traffic, so extended online transfers are unacceptable. Which ingestion approach best meets the constraints?
Use Storage Transfer Service to pull the data from the data center to Cloud Storage during nightly off-peak hours over the existing 200 Mbps link.
Request a Google Transfer Appliance, copy the HDFS data onto the device onsite, and ship it to Google for bulk import into Cloud Storage.
Deploy Storage Transfer Service agents in the data center to continuously stream the HDFS data to Cloud Storage over the public internet.
Create a Dataproc cluster in Google Cloud, establish a VPN to the on-premises Hadoop cluster, and run a DistCp job to copy the data.
At 200 Mbps, transferring 400 TB over the network would take well over 200 days (400 TB × 8 bits/B ÷ 200 Mb/s ≈ 17.6 million seconds ≈ 204 days) and would monopolize the already-constrained link. Google Transfer Appliance is specifically designed for one-time, petabyte-scale migrations from on-premises environments to Cloud Storage by shipping an encrypted appliance to Google's ingest facility, eliminating reliance on WAN bandwidth and completing within the desired two-week window once the appliance is returned. Storage Transfer Service with an online agent or off-peak scheduling, gsutil copy jobs, and VPN-based DistCp all depend on the limited internet link and cannot meet the time or bandwidth constraints, making them unsuitable choices.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is Google Transfer Appliance?
Open an interactive chat with Bash
Why isn't Storage Transfer Service suitable for this scenario?
Open an interactive chat with Bash
How does Google Transfer Appliance ensure data security during migration?
Open an interactive chat with Bash
What is Google Transfer Appliance?
Open an interactive chat with Bash
Why is network bandwidth critical for large-scale data migrations?
Open an interactive chat with Bash
How does Coldline Cloud Storage optimize costs for long-term data retention?
Open an interactive chat with Bash
What is Google Transfer Appliance?
Open an interactive chat with Bash
How does Coldline Cloud Storage differ from other storage classes in Google Cloud?
Open an interactive chat with Bash
Why is the VPN-based DistCp approach unsuitable for this migration?
Open an interactive chat with Bash
GCP Professional Data Engineer
Ingesting and processing the data
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99 $11.99
$11.99/mo
Billed monthly, Cancel any time.
$19.99 after promotion ends
3 Month Pass
$44.99 $26.99
$8.99/mo
One time purchase of $26.99, Does not auto-renew.
$44.99 after promotion ends
Save $18!
MOST POPULAR
Annual Pass
$119.99 $71.99
$5.99/mo
One time purchase of $71.99, Does not auto-renew.
$119.99 after promotion ends
Save $48!
BEST DEAL
Lifetime Pass
$189.99 $113.99
One time purchase, Good for life.
Save $76!
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .