Running BI on MongoDB through Trino
Some BI tools don’t natively support querying MongoDB databases. While you shouldn’t run data warehousing on MongoDB, it may still be…
Gatsby Starter Blog RSS Feed
An engineering blog about parallel computing
Latest posts
Introduction to focus tracking
I am a big believer in using personal data to drive my own performance. I like podometers, smartwatches, fitness rings. I’ve always felt…
How to refresh an imagePullSecret token secret, the hard way
TL;DR this is a niche issue I encounter because I run a DigitalOcean k8s cluster with a private GitHub registry. If you’re using a public…
How to properly benchmark queries on Snowflake
When I see people trying to test the performance of queries, I typically see them making a few key mistakes that may affect their results…
How DuckDB enables unit testing SQL queries
During my first data engineering gig at Amazon in the audience insights team, I took for granted the unit testing of Spark code. Those were…
Detecting missing data with z-scores
Introduction When loading time-series data into a data warehouse, you typically want to verify that you have successfully loaded all the…
JWT with CORS for FastAPI
The problem: If you implement it naively, the bearer token you send never reach the server. This is an issue of chicken and egg because if…
Spark Shuffle, the good and the bad
Shuffling is a fundamental operator for transferring data between stages (and nodes) in Apache Spark. It was already a cornerstone of the…
How is NCCL so fast?
NCCL, the state of the art library for distributed DNN training on GPU, has a reputation of not having much documentation on its design. No…
Autofocusing a microscope (SEM) in Python
Like in everyday photography, it is crucial in (electronic) microscopy to get images that are not blurred. The focus, is the process of…
About
Hi, my name is Fred, a computer scientist particularily interested in compilers, deep learning, hardware accelerators, parallel computing…
AmiScan
AmiScan is an innovative startup project focused on automating the analysis of asbestos samples using electron microscopes. It is able to…
Amy Compiler
Full Compiler with hand-written tokenizer, parser, analyser, and code generation to WebAssembly written in Scala, for a toy language subset…
Quantum circuits for generating Bell diagonal states
Improvement on previous implementations of quantum circuits to generate the full spectrum of Bell Diagonal states on the IBM quantum…
Keylogg
Chrome extension to track typing speed, enabling users to analyse their actual productivity, and get alerted when they are becoming tired or…
Parallel-RePlAce
Improvement of performance on the state of the art (at the time) VLSI placer. Analysis and reduction of memory footprint leading to 2x…
StudyBuddy
Android app to help form and manage study groups on university campuses, allowing students to easily connect with peers sharing similar…