Random musings, ideas, implementations and experiments in and around the world of AI Audio
Here is a neat method I found to make accessing blob storage extremely painless in the Python data eco-system. It’s especially nice since the tools it relies on are extremely widely supported. So if that sounds interesting read on.
A project that I have been working on required some functionality to do the following; fetch a compressed tar archive from the internet, extract it, do some munging on the files and then dump it out to blob storage. In the interest of efficiency I didn’t want to have to download the files, save to to disk and then extract before beginning to process them. Instead I opted to stream the download,…
In this post I’ll demonstrate how to use DuckDB, an in memory SQL engine, optimized to perform on big data within your laptop, to serve a real-time analytics use case, served by FastAPI and using dbt as the data build tool to manage the pipeline functionality.
Check over here for the code for the release that goes along with this discussion.
In this article I will describe how to produce an all local data platform using the RADDD data stack (everyone’s talking about it, promise), the stack consists of 4 layers that work together to provide a fast, tunable platform that can scale to production seamlessly.
Today I will describe how to produce an all local data platform using the RADDD data stack (everyone’s talking about it, promise), the stack consists of 4 layers that work together to provide a fast, tunable platform that can scale to production seamlessly.
This technical report explores the use of ChatGPT API to automatically document DBT projects. ChatGPT is a natural language processing API that can generate human-like responses to prompts. We will be using the Obsidian ChatGPT MD plugin for this project, which provides a workflow to develop prompts for our documentation.
How a machine learning model was served to \(25,000\) users for only $2!