Your company ingests 4 TB of raw click-stream files into a Cloud Storage bucket every day. Data scientists only analyze the most recent 14 days of data, while the rest must be retained for 13 months to satisfy quarterly compliance audits. Historical data might be accessed at most a few times per year and can tolerate several hours of retrieval latency. To minimize storage costs, what should you do?
Use an object lifecycle rule to retain the first 14 days in Standard storage and transition older objects to the Archive storage class for the remainder of the retention period.
Move objects older than 14 days to a Filestore instance mounted on persistent SSDs, starting and stopping the instance when needed.
Load all files into BigQuery, relying on automatic long-term storage pricing after 90 days for cost reduction.
Keep all objects in the existing bucket using the Standard storage class to avoid retrieval fees.
Archive storage is the lowest-cost Cloud Storage class and is designed for data that is retained for long periods and accessed infrequently; objects can be retrieved within hours, which matches the tolerance described. Keeping the newest 14 days in the Standard class avoids per-GB retrieval charges and provides low-latency access for the analysts. A lifecycle rule that automatically transitions objects from Standard to Archive after 14 days eliminates manual effort and prevents paying Standard rates for terabytes that are rarely read. Leaving everything in Standard would keep costs unnecessarily high. Loading the data into BigQuery still incurs higher monthly storage fees than Archive and adds query costs. Moving data to Filestore places it on persistent disks priced significantly above Archive storage and requires an always-running instance, further increasing expense.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is an object lifecycle rule in Cloud Storage?
Open an interactive chat with Bash
What is Archive storage in Google Cloud?
Open an interactive chat with Bash
Why not use BigQuery for storing large datasets like click-stream data?
Open an interactive chat with Bash
What is a Cloud Storage lifecycle rule?
Open an interactive chat with Bash
What is the difference between Standard and Archive storage classes in Cloud Storage?
Open an interactive chat with Bash
Why is Archive storage better than BigQuery or Filestore for infrequently accessed data?
Open an interactive chat with Bash
GCP Professional Data Engineer
Maintaining and automating data workloads
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .