building things
this post is in continuation to my v0.1.0 release post , 3 weeks ago I released the initial version of walrus and shared it with the community and receives quite a lot of invaluable feedback, I have attempted to include many of those changes in this release and more. (if you havent read the initial post, please do so before reading this) tldr. walrus v0.2.0 introduces new features like new FD…
tldr; a fast Write Ahead Log in Rust built from first principles which achieves 1M ops/sec and 1 GB/s write bandwidth on consumer laptop, find it here: github most low level stuff is self explanatory from the relatively lean(~1000 LOC) core engine file , this is more of a higher level architecture intuitions and my thoughts on it. architecture design is oversimplified 1 walrus is a single-node,…
github A lightweight application layer networking protocol that ensures resilient message delivery and connection handling without any hassle for the user. Core Features Reliable Message Delivery The protocol guarantees FIFO message delivery. Every message is considered read only when the receiving peer acknowledges it, ensuring reliable communication with built-in ACKs. Complete Networking…
github Core Architecture Lock Contention Minimization The system minimizes lock contention at multiple levels. It’s optimized for high-frequency write workloads since lock contention is kept to a minimum. Nearly all operations are lock-free. Dynamic Scaling The engine scales up and down dynamically on its own. When load per shard increases, the system spawns more shards in the new engine and…