How does it work?
Last updated
Last updated
What is the Query Optimizer and how does it work?
The Query Optimizer is a layer that sits between BigQuery and Looker (or any other client like python or java) connecting to the BigQuery API. This can be tested and validated by changing the API host i.e in the BigQuery Python Client.
The proxy implements all functionality of the BigQuery API, in fact it passes most API calls forward and only interacts with SQL payloads.
At the moment, the proxy is focused on optimizing analytical workloads (i.e SELECT statements), but there is also a roadmap for it to be further developed to optimize data pipelines (dbt, airflow etc).