When databases don't make sense, use Parquet.
LakeQL + parquet is how I database now.
erik’s Substack
Bracing against the wind: no longer self-hosted. A continuation of where I started a long time ago.
Live Last read · last published · next check
Latest posts
Sites I've built recently
Aside from my job, I like to build random sites.
Stochastic Rounding is Better
Rounding so that aggregates work
GPT: Arguments against taxation
Title: The Great Tax Debate
Get block size bash
Probe for block size.
Viral load
Quintiles put the poster I made up on their site: Identifying viral load in tumors using nextgen sequencing. Thanks Kim!
Gene therapies I want to see developed
Gene therapies I'd love to see developed/tested in my lifetime:
Clustered Object Encoding 2.0
Without going into detail about of "the cloud" and the exaggerations and mysticism that accompany it, here's some definitions that it took me a while to truly understand:
Variable Length, Zipf's Law and Density Functions
When coding, variables should be named based on both frequency and the length of their context.
Capricious Job Scheduling
Using a perfectly fair scheduler, I launch 5 processes with the following pattern: