Dataform is Google Cloud's free SQL transformation tool for BigQuery. Learn its key features, dbt comparison, pricing model, and how data teams use it daily.
Dataform is a Google Cloud service for developing, testing, and orchestrating SQL-based data transformation pipelines natively inside BigQuery. It originated as an independent London startup founded in 2017 by Lewis Hemens and Guillaume-Henri Huon, before Google Cloud acquired it in December 2020.
Since the acquisition, Dataform has been rebuilt as a BigQuery-native product, dropping its earlier multi-warehouse support in favor of tight integration with Google's own data platform.
Dataform lets analytics engineers define SQL transformations with automatic dependency resolution, real-time error checking, and a visual dependency graph, plus data quality assertions for testing.
Native Git integration connects Dataform repositories to GitHub or GitLab for version control and code review, while workflows can be scheduled via Cloud Scheduler, Cloud Workflows, or Managed Apache Airflow.
Dataform itself is a free Google Cloud service with no direct licensing fee. Costs instead come from the underlying BigQuery queries Dataform runs, plus Cloud Logging and any orchestration services used (Cloud Scheduler, Workflows, or Managed Airflow).
This makes Dataform effectively free to adopt for teams already using BigQuery, since there is no separate transformation-tool subscription on top of existing Google Cloud spend.
Dataform itself has no direct licensing fee, but running its SQL transformations incurs standard BigQuery query costs, plus Cloud Logging and any orchestration service charges.
Dataform is used to develop, test, version-control, and schedule SQL-based data transformation pipelines that run inside BigQuery.
Dataform is a free Google Cloud service tightly integrated with BigQuery only, while dbt is an independent, multi-warehouse transformation framework supporting Snowflake, Redshift, Databricks, and more.
Dataform was founded in 2017 by Lewis Hemens and Guillaume-Henri Huon in London and acquired by Google Cloud in December 2020.
Yes, Dataform integrates natively with Git and supports connecting repositories to GitHub or GitLab for commits and code review.
No, since being rebuilt as a Google Cloud product, Dataform is designed to run natively and exclusively inside BigQuery.