Hand-written notes on Kubernetes, Airflow, cloud infrastructure and the plumbing underneath.
Ceph is a distributed storage system built that consists of a few daemon processes. OSDs - object storage daemons are the workers that actually store bytes, one per disk. your data gets broken into objects and spread across OSDs monitors (mons) - hold the cluster map and know which OSDs exist, which are up, where data lives. RADOS - reliable autonomic distributed object store. the object layer…
Today a colleague shared some mockups via a Github.com link. The link led me to the raw HTML file. I don't wanna see that, I wanna see the mockup. I couldn't find a button in the Github UI that allowed me to do that. I could download the file and open it up in my browser, but I would rather be able to do it in one click. So I worked with an agent to build this browser extension that lets me right…
Sometimes I need to create self-signed certificates and interact with an application in the browser. The browser and OS don't really like that. But I know its secure, and temporary, so I want to tell my computer to chill out and trust the CA. Command I use to generate the self-signed cert: openssl req -x509 -nodes -days 365 -newkey rsa:2048 \ -keyout mycert.key -out mycert.crt \ -subj…
Kubernetes is often called an orchestrator of container-based applications. But it doesn't actually run them. Sure, there is a kubectl run , but it doesn't actually create a process that gets the container running. Well, it is kind of a strange term in this context because Kubernetes is not one thing. It's a collection of software that all work together to accomplish a goal of getting…
In my last post, I was asking the question, "What does open-weight mean?". This led to me learning about neural networks. I'm going to try building a neural network myself right now, and I'll share what I find interesting throughout this adventure. Imagine you are trying to decide whether or not now is a good time to go on a hike. What questions would you be asking yourself? For me, it would be…
I was browsing the headlines of Hacker News and came across one called China's open-weights AI strategy is winning . I had been curious what the term "open weights" means, so I spent an hour or so learning a few things, and I will share what I learned with you right now. Let's begin with the word weight . In neural networks, a weight is a single number that controls how strongly one part of the…
I was reading the Disruption section of the Karpenter docs and the first sentence says, Karpenter sets a Kubernetes finalizer on each node and node claim it provisions. I then decided to take some time to understand what finalizers are. Here's my understanding... They are kinda like garbage collectors . They tell kubernetes what operations to perform before a resource can be removed . But these…
Run this command in a separate terminal while your program is running in a different one: sudo fs_usage -f filesys | grep PROGRAM Gold!
I was trying to create an OpenShift cluster on Azure and kept running into this concept of a Service Principal. Let's take a look. First of all, when you create a new ARO (Azure RedHat OpenShift) cluster deployment, a service principal is automatically created. To interact with Azure APIs, a Microsoft Azure Red Hat OpenShift cluster requires a Microsoft Entra service principal. This service…
Using the AWS Secrets and Configuration Provider (ASCP) with the Kubernetes Secrets Store CSI Driver, you can mount secrets stored in Secrets Manager as volumes in Kubernetes Pods. External secrets is another approach. There is no single "best" choice between AWS Secrets and Configuration Provider (ASCP) and External Secrets Operator (ESO) for managing AWS Secrets Manager secrets. Each tool has…