Dataform

Dataform Tips – Protect an Incremental Table from Accidental Full Refreshes

Incremental queries in Dataform always include two modes for updating the destination table: incremental & full refresh. However, sometimes, it’s necessary to implement safety measures against an accidental full refresh. The reasons for that include: How can a full refresh happen by mistake? Dataform workflow invocations target specific queries that will be executed. However, they […]

Dataform Tips – Protect an Incremental Table from Accidental Full Refreshes Read More »

Dataform Tips – Managing Column Descriptions

Many of us consider writing documentation a bit of a dull task. Organizations make it even worse by hoarding the documentation in centralized but isolated systems such as Confluence. This approach can easily lead to a situation where writing documentation becomes a project of its own.  Ideally, the documentation would evolve continuously whenever the queries

Dataform Tips – Managing Column Descriptions Read More »

how to create a GA4 ecommerce table in BigQuery - header image

GA4 BigQuery – Ecommerce Table with Item List Attribution

When you start working with GA4 data in BigQuery, you’ll hear that you should avoid connecting your dashboards directly to the raw data export tables. The reasons behind this include query performance and cost optimization. The need for optimizing your data sources is especially true when working with item-level ecommerce data. In this post, I’ll

GA4 BigQuery – Ecommerce Table with Item List Attribution Read More »

dataform trigger overview

Run Dataform queries immediately after the GA4 BigQuery export happens

The daily BigQuery export schedules for GA4 are notoriously random. Sometimes the data is processed in the early-morning hours, sometimes at noon, and sometimes not even during the next day. In this article, I’ll walk you through how to set up a Cloud Workflow that compiles and executes the selected queries in your Dataform project.

Run Dataform queries immediately after the GA4 BigQuery export happens Read More »

Scroll to Top