Looking for a way to easily transform data from BigQuery? In this episode of Serverless Toolbox Extended, we show you how to transform BigQuery datasets into easy-to-read dashboards via a data build tool (dbt). Moreover, we’ll show you how to use Cloud Build, Cloud Run, and Cloud Scheduler to build a dbt container image, eliminate server maintenance, and automatically trigger run times for dbt commands. Watch to learn how you can use serverless to run a dbt command and transform your datasets in BigQuery!

Timestamps:

  • 0:00 - Overview
  • 1:03 - Running dbt with BigQuery
  • 3:08 - Creating runtimes for dbt with Cloud Run
  • 4:00 - Running a shell script in Cloud Run
  • 5:00 - Containerizing code with Cloud Build
  • 5:19 - Deploy container to Cloud Run
  • 7:04 - Setting up Cloud Schedule to automatically run your dbt
  • 10:00 - Summary

#serverless #developer

Scheduling DBT Jobs with Serverless
5.25 GEEK