Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings
This repository was archived by the owner on Mar 6, 2026. It is now read-only.
This repository was archived by the owner on Mar 6, 2026. It is now read-only.

Query performance optimizations #362

Copy link
Copy link

Description

@tswast
Issue body actions

This issue tracks the "fast query path" changes for the Python client(s):

  • perf: use jobs.getQueryResults to download result sets #363 -- Update QueryJob to use getQueryResults in RowIterator. Project down to avoid fetching schema and other unnecessary job stats in RowIterator.
  • perf: cache first page of jobs.getQueryResults rows #374 -- Update QueryJob and RowIterator to cache the first page of results, which we fetch as part of the logic to wait for the job to finish. Discard the cache if maxResults or startIndex are set.
  • perf: use getQueryResults from DB-API #375 -- Update DB-API to avoid direct call to list_rows()
  • perf: avoid extra API calls from to_dataframe if all rows are cached #384 -- Update to_dataframe and related methods in RowIterator to not call BQ Storage API if cached results are the only page.
  • Update DB-API to not call BQ Storage API if cached results are the only page.
  • Update Client.query to call jobs.query backend API method for acceptable job_configs.
  • (optional?) Avoid call to jobs.get in certain cases, such as QueryJob.to_dataframe and QueryJob.to_arrow
    • Add "reload" argument to QueryJob.result() -- default to True.
    • Update RowIterator to call get_job to fetch the destination table ID before attempting use of BQ Storage API (if destination table ID isn't available).
Reactions are currently unavailable

Metadata

Metadata

Assignees

Labels

api: bigqueryIssues related to the googleapis/python-bigquery API.Issues related to the googleapis/python-bigquery API.type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.‘Nice-to-have’ improvement, new feature or different behavior or design.

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

    Morty Proxy This is a proxified and sanitized view of the page, visit original site.