BigQuery and holidaysLearn how to create a table of vacation days in BigQuery using PythonNov 8, 2023Nov 8, 2023
Published inCompendiumUnderstanding BigQuery CostsIn this article you will learn what drives BigQuery costs and I will show a SaaS solution that can help you analyze the costs instantly!Mar 29, 2023Mar 29, 2023
Published inCompendiumGCP Workload identity federation on Gitlab passing authentication between jobsGitlab (late 2022) is relatively new to workload identity federation, and there are not many good templates or guides out there. The…Nov 30, 2022Nov 30, 2022
Published inCompendiumUsing dataform to improve data quality in BigQueryGet inspired on ways to use dataform to monitor and improve your data quality!Aug 31, 2021Aug 31, 2021
Published inCompendiumBuilding a serverless datawarehouse pipeline using GCPTraditionally, building a data warehouse requires massive capital investments in infrastructure, tools and licenses to get insight to your…May 7, 20211May 7, 20211
Copy SQL Server data to BigQuery without CDCSometimes you just want data from your source into your analytical tool and start doing experiments.Apr 23, 2021Apr 23, 2021
Published inCompendiumBest practises for KubernetesPodOperator in Cloud ComposerIn this post I will go through best practises on using the KubernetesPodOperator with examples. I will share dags and terraform scripts so…Oct 16, 20203Oct 16, 20203
Published inCompendiumArgo workflows as alternative to Cloud ComposerBackgroundMay 5, 20201May 5, 20201
Troubleshooting cloud composerIs cloud composer suddenly starting to miss deadlines? this blog might give hints to why composer is misbehaving and how to fix it!Apr 28, 20201Apr 28, 20201
Published inCompendiumDebug a python workload that has gone silent (hung) inside kubernetesToday I was at a customer helping them to optimise their Cloud Composer setup. Cloud composer is a managed airflow installation, a job…Dec 9, 2019Dec 9, 2019
