Your analytics platform launches 180 independent interactive SQL queries in the same BigQuery on-demand project every night at 00:00 to refresh aggregate tables. After recent growth, roughly half of the jobs now fail instantly with the error message "Resources exceeded: Too many concurrent queries for this project." All queries must still complete by 01:00, and you must continue to use on-demand (per-query) pricing. With the least additional operational effort, how should you eliminate the failures and meet the deadline?
Change all of the jobs to batch priority so they queue until resources are available and no longer hit the interactive concurrency limit.
Request a higher concurrent interactive-query quota for the existing project in the Google Cloud console.
Purchase a 500-slot BigQuery capacity reservation for the project and rerun the jobs using capacity pricing instead of on-demand pricing.
Create a second Google Cloud project, share the necessary BigQuery datasets, and schedule roughly half of the queries from that project to avoid the per-project concurrency cap.
BigQuery on-demand projects are limited to 100 concurrent interactive queries, and this limit cannot be raised. Jobs submitted beyond that limit fail with the quoted error. Converting the workload to batch priority would queue excess jobs and might delay their start by up to 24 hours, breaching the one-hour SLA. Purchasing slot reservations would switch the project to capacity pricing, which is prohibited by the requirement to stay on on-demand. By creating another project, sharing the necessary datasets, and scheduling about half of the queries from that project, you effectively double the available concurrency while keeping on-demand pricing and making only minimal scheduling changes.
Ask Bash
Bash is our AI bot, trained to help you pass your exam. AI Generated Content may display inaccurate information, always double-check anything important.
What is the concurrency limit for BigQuery projects?
Open an interactive chat with Bash
How can datasets be shared across multiple Google Cloud projects?
Open an interactive chat with Bash
What’s the difference between interactive and batch query priority in BigQuery?
Open an interactive chat with Bash
What is the per-project concurrency limit in BigQuery?
Open an interactive chat with Bash
How are interactive queries different from batch priority queries in BigQuery?
Open an interactive chat with Bash
Why is creating a second Google Cloud project the best solution in this case?
Open an interactive chat with Bash
GCP Professional Data Engineer
Maintaining and automating data workloads
Your Score:
Report Issue
Bash, the Crucial Exams Chat Bot
AI Bot
Loading...
Loading...
Loading...
Pass with Confidence.
IT & Cybersecurity Package
You have hit the limits of our free tier, become a Premium Member today for unlimited access.
Military, Healthcare worker, Gov. employee or Teacher? See if you qualify for a Community Discount.
Monthly
$19.99
$19.99/mo
Billed monthly, Cancel any time.
3 Month Pass
$44.99
$14.99/mo
One time purchase of $44.99, Does not auto-renew.
MOST POPULAR
Annual Pass
$119.99
$9.99/mo
One time purchase of $119.99, Does not auto-renew.
BEST DEAL
Lifetime Pass
$189.99
One time purchase, Good for life.
What You Get
All IT & Cybersecurity Package plans include the following perks and exams .