Gavin Campbell

gavincampbell.dev

After many years working with SQL Server and the Microsoft BI stack, followed by a long excursion into DevOps, and a return to the Data world with Databricks, my work now revolves around improving working practices in Data Engineering across a range of technologies.

Gavin Campbell's Sessions

Databricks Asset Bundles: Putting the Engineering into Data EngineeringSQLBits 2026

Learn how to automate Databricks deployments with Asset Bundles and GitHub actions

Data Engineering the Hard Way: Developing Spark Applications on KubernetesSQLBits 2022

Self-hosting Spark in Containers

Databricks Asset Bundles: Putting the Engineering into Data EngineeringSQLBits 2026

Learn how to automate Databricks deployments with Asset Bundles and GitHub actions

Unity Catalog Schema Management with FlywaySQLBits 2026

Using Flyway Community Edition to manage change in Unity Catalog

Automated Acceptance Testing for PysparkSQLBits 2022

Testing PySpark code with pytest-bdd

Data Engineering the Hard Way: Developing Spark Applications on KubernetesSQLBits 2022

Self-hosting Spark in Containers

Ephemeral Development Environments with Terraform and GitHub ActionsSQLBits 2022

Managing Azure resources with GitHub actions and Terraform