Vibe coding a game in 2026 as a data engineer
The Ceiling of my vibes: Building a Game with LLMs when you are not a game developer If you read my other blog posts, or know me well enough…
A port of the casper blog built for gatsby
The Ceiling of my vibes: Building a Game with LLMs when you are not a game developer If you read my other blog posts, or know me well enough…
If databases were rappers (thoughts from a Generative AI) Can you relate to these? Following from my previous posts where we explored what…
Implementing a Component-Based Design System in Power BI Standard Power BI headers, buttons, and callouts often feel disconnected from an…
How to commit a Power BI report to Git The files from this blog post can be accessed here: https://github.com/mortie23/pbip-nfl/pull/…
Loan Logic: A Mortgage scenario modelling application Background I have always been interested in financial modelling and how different…
PyTPT: A Python Wrapper for High-Performance Teradata Data Loading This blog post is paired with the associated Github repository https…
Can you relate to these? As of writing this blog post, I have been really enjoying the new releases in Google’s Gemini AI for both images…
Quackpipe Stop waiting for AWS Glue jobs while in development by using a local-first workflow with DuckDB and deploy with Terraform. Your…
Query SalesForce objects with Python Ever found yourself exporting data from Salesforce using the Web UI over and over again. Ever wished…
Python applications published to Posit Connect This is a simple Streamlit application structured as a modular project and managed using…
NFL Touchdown Prediction with Dataform and BigQuery ML This blog post demonstrates how to build an end-to-end ML pipeline using Google Cloud…
This blog post is the first, and probably last where I thought I would see what the Github Copilot VSCode extension could do with writing a…
Deploying ML Models on Cloud Run: From Placeholder to Production This guide walks through deploying a machine learning model on Google Cloud…
Public IP address of a GCP Cloud Function When you deploy a Cloud Function without configuring a VPC, it operates within Google’s internal…
Can you relate to these? Inspired from these (https://leftoversalad.com/c/015_programmingpeople/), let’s see what a Generative AI thinks of…
Debugging Dataform with Node.js in VScode Debugging Dataform JavaScript If you happen to be a data engineer who is not familiar with the…
Scraping web data using GCP Cloud Functions The main reason for this blog post is a practical example of writing a GCP Cloud Function with…
Flask application with custom package deployed to GCP Artifact Registry and Cloud Run What we are looking to do in this example is…
Why do this? When using Dataflow Google-provided templates for any RDBMS to BigQuery (such as PostgreSQL to BigQuery) the target table in…
Background Often as software engineers working within organisations we are coerced into using a software stack that we may not have chosen…
Encrypting credentials Google KMS Cloud Key Management Service (Cloud KMS) lets you create and manage encryption keys for use in compatible…
Dataflow build and run Basic example of how to develop an Apache Beam pipeline written in Python that writes data to BigQuery. To then build…
Copying a table from Teradata to Google BigQuery For this demo I will be using a Windows PC including: Teradata Studio Teradata ClearScape…
Connecting Nifi to Teradata For this demo I will be using a Windows PC including: Docker desktop PowerShell Core 7.3.6 VMWare Workstation…
Introduction As a Hip-hop fan (and other genres of music) it is obvious that certain artists are more alike than others. I was interested to…
Flask app with a Postgres database containerized across multiple clouds Background We are building out an application that has a decoupled…
Reading and Writing data between Python and Teradata This blog post is paired with the associated Github repository https://github.com…
Mono repo with Python Poetry What we are looking to do is create a code repository that can be used as the source for many Python…
Overview We want to test out the installation and management of Posit Connect (previously RStudio Connect). Prerequisites A machine running…
Overview Let’s say we want to manage an R code base as a package. The benefits might include: a good way to distribute R code for other…
Overview Let’s say we have a brand new Databricks resource that we have just created from Azure. It comes as an empty shell ready for use…
DevOps CICD Pipeline for Databricks This is in reference to this Git repo https://dev.azure.com/mortimer-xyz/mortie23/_git/dbfs-cicd-pieline…
Registering a model in AzureML from Databricks What if we want to use AzureML as a central model repository for all models across many…
Use Docker to host a Python FastAPI service In my preview blog post (Model scoring API) I went through the technical basics of a model…
Fit a decision tree model for predicting win or loss The code this post is relating to is here: https://github.com/mortie23/databricks-nfl…
Create a Databricks database with sample NFL data The code this post is relating to is here: https://github.com/mortie23/databricks-nfl-data…
A basic example of a predictive model scoring API The associate Github repo for this blog post is https://github.com/mortie23/fastapi-linear…
How to commit a Power BI PBIX to Git NOTE: this blog post has been superseded by Power BI PBIP Git version control This is in reference to…
Using a post receive hook for website deployment Other deployment methods Firstly, let’s mention that there are other potentially easier…
Building a time lapse server with a Raspberry Pi and a webcam I had a Raspberry Pi lying around that I use to use as a media server, and an…
Dynamic images in Power BI Getting images to be dynamic, such as changing in reaction to an change in the selected value of a slicer seems…
What is Retool Retool is a simple tool for creating a web application. One of the things that makes Retool great is you’re never limited by…
Reading Firstly I came across the following docs on how to install prefect server Prefect Server 101 Deploying to GCP Deploying to a Single…
What is Secret Santa an arrangement by which a group of friends or colleagues exchange Christmas presents anonymously, each member of the…
Why Working on Javascript code in Visual Studio Code (VSCode) for the best part of last year got me use to all the good stuff…
What is the issue? Collaborating on a repo and someone accedientally commits a very large file that is not very compressable. It makes the…
What are we doing We have a server hosting RStudio, and we want encrypt the traffic too and from the RStudio service. We also do not want to…
Using Tableau Web Data Connector (WDC) as the data source for dashboard. This post is in reference to the associated Github repo at https…
I was experimenting with Agent based models and came across a really great talk Jackie Kazil | Agent based modelling in Python. This lead me…
Putting analysis on a map People always seem to like seeing data visualised on a map. Something about looking at a gradient of colour on a…