I’ve been running local LLMs for a while now and the eternal struggle is always the same: you want more context, more model, more speed — and you have none of the VRAM to support any of it. So when Gemma 4 dropped with 262K context window I obviously had to try fitting the whole thing on my RTX A5000. 16GB. Turns out you can. And its actually usable. ~658 tok/s prompt eval. ~35 tok/s decode.…
I’m building several projects in confidential inference space ( enclava.ai , Mango AI ) so I tend to stay on top of providers in the space, what they offer and how the industry is developing. I’ve had many conversations with friend building AI things about inference providers, explaining them which providers to use or more frequently just letting them know that there are alternatives.…
TLDR: No provider lock-in. No subscriptions. Own your data data. Bring your own key. Protect your chats. And delete them if forced to unlock the app. No tracking, no analytics. The app that serves you. Privacy is dead. Long live privacy. Wrong. There are still a few of us out there that believe in it. A few that are trying to build software for users that value it. Software that works for the…
Since the dawn of computing we’ve been handing over our data to machines we don’t control. First it was the mainframe in the basement, then the server in the data center, now the container in someone else’s cloud. The bargain has always been the same: convenience in exchange for trust. You trust that the admin won’t peek at your data. You trust that the code running is what…
(in case you just want the github link without reading the hallucinations of my neural network - here you go ) I hate voice memos. Mostly I hate to receive them. You can’t quickly glance over to remember the content of the conversation, the key piece of information you need is hidden in a 3minute voice note. But I recently learned that talking to machines is quite practical. I even tweeted…
Today I came across this tweet about speed reading and I was immediately intrigued. I was a fan of it back in my younger days when I wanted to consume as much knowledge as possible. I never had the patience to become very proficient in it but I did pick up a thing or two. I’m still generally a fairly fast reader, even when I read for pleasure. But who wouldn’t want to read more books?
I’ve covered the creation of new lightning network backend plugin for BTCPay server in the previous post so if you want a long winded post about it read it there . This is part 2, primarily focusing on the new improvement I’ve added to it - automated treasury management. Spark’s security model (statechain) is not everyones favorite cup of it. Its not even mine favorite cup of…
I first came across BTCPay Server in very early days, I remember seeing the now famous tweet which effectively announced the project. In 2018 I’ve even tried to get Bitstamp, my employer at the time, to support BTCPay Server and integrate Bitstamp as an offramp for merchants. Sadly that never went anywhere, but it was when I first talked to (yes, we had a voice call like neandarthals)…
I’ve been using linux for many years now and every few years I get the urge to switch from GNOME to a tiling window manager. But every time I was tempted to make the switch, I ran into the same problem: the learning curve was just too steep. I don’t want to spend hours configuring my system just to get it to a usable state. I treat my computer as a tool, not a hobby project. Its one of…
I’ve created a subpage on this site dedicated to various tools (the subset of them that are mature enough for me to dare mention them) -> you can find them here . I do not commit to any level of regular maintenance of them, they get fixed when they need fixing (which is usually when I’m in a rush to do something and I realize everything is broken). Occasionally these things find a life…
I’ve stumbled upon Bitkarrot ’s repo a while back and said to myself, “Why not visualize the Euro to Satoshi exchange rate over time?”. As that was the 1337th side project idea I had, I managed to find the restraint to not start it immediately. But as luck would have it I got some free credits from Anthropic to try out their new Claude Code Web which meant that now I had a…
Its been probably several months since i’ve been postponing migrating from ghost to something else. Ghost served me well but I wanted something simple, markdown based that I can move around and host easily. Ghost needs updating, database management, backups etc. Its not that hard to maintain but its more work than I want to do for a simple blog. So here it is, mostly migrated content from…
Github is the thing we all love to hate and tend not to get rid of because its just too damn useful. But it dawned on me that its also one of the biggest single point in all of my infrasturcture, sure the repositories exist on multiple machines and I probably wouldn’t lose any/much data in the end, but its far from organized nicely and I would spend a lot of time actually putting things…
Somewhere a True Believer is building tools to free you. He is building with minimum resources, in austere conditions, day and night. The only thing dear to him are his tools, and he made them from second hand parts. He doesn’t worry about what to build - he builds what he knows, what inspires him. His work never ends. The True Believer doesn’t care how hard it is; he only knows that…
A quick tutorial for people who want to run goose but want it to keep your data confidential you generally have two options. First its to buy a good gpu to run a model locally, the second one is use advancement in trusted execution environments and use confidential AI backend with it. How to do it Go to PrivateMode and create an account and an API key. Then, set the environment variable…
Published originally by Max Hillebrand on nostr . To The Governments & People of Earth: We claim the right to exist, and we will defend it. We do not seek to overthrow anything. We do not seek to control anything. We/merely wish to be left alone. All we ever wanted was to live in peace with our friends and neighbors. For a long, long time we bore insults to our liberty; we took blows, we did what…
Its 2025 but sending a video from one person to another and assuming they will be able to open it on their device is still something we need to wait for AGI to be achievable. Back in the day everyone had installed K-Lite codec pack to watch pirated movies. Now I’m trying to send product demos around and iphone users can’t watch them. But luckily we have the almighty ffmpeg that always…
I’ve recently had the need to set up wordpress quickly for some testing while developing a new woocommerce extension and I’ve stupidly needed way more time than I hoped to have a working set up in docker so here’s the setup. docker-compose.yml services : wordpress : image : wordpress:latest container_name : wordpress ports : - '12999:80' # Only expose HTTP to the host environment…
No cookies, no banners, no analytics, no frameworks, no junk. Good old web 1.0. html + css + javascript. -> timeconvert.org A while back I’ve had one too many timestamp conversion cases to deal with while building some data ingestion pipeline and I’ve ended up creating this website to scratch my own itch. I know epoch converter exists but it has tons of popups/cookie consent banners,…
Over time I’ve been slowly hoarding and studying a lot of old(er) crypto anarchy and cypherpunk materials over time, like the the untold story of the greatest crypto project ever that I’ve posted about before . I’ve been running my own backup of anarplex in case Eric Sirion’s ever goes offline. I also have copies of other materials like Taz0 and second realm series from…
I spend a considerable amount of my time in terminal(s) and I’ve gotten used to incorporating large language models into my workflow. But occasionally its just too annoying to switch over to a browser to ask it something. My previous solution for that was that I had a telegram bot that I’d chat with (which was convenient and faster than web) but I felt something was missing. And today…
If you only clicked on the post to tell me crypto sucks let me disappoint - crypto in this case stands for cryptography, as it is for a long time before shitcoins came into existence. Many of you might have read Paul Rosenberg’s amazing A lodging of wayfaring men . Some of you might even know that Max Hillebrand recently created an audiobook version of it . But there is a story that predates…
I’ve started a practice of keeping my research bookmarks in a public github repository couple years back. Initially it was just so I could easily point my friends somewhere when they started asking questions about the topics we were discussing. Some of them became quite popular, the others not so much (I forgot about one when writing this post). nostr.net I’ve written about…
In a world of explosive amount of content about AI and where NOT having an AI newsletter has become a rarity there are a few authors and sites I like to read for their more thoughtful and long form content: Recommended Resources The following sites are highlighted for substantive coverage: gwern.net - Features deep learning content alongside other topics ym2132.github.io - Focuses on extended…
I’ve started awesome-nostr repo in Jan 2022 as a personal bookmark project and helping the back then relatively tiny community of nostr enthusiasts collect all the interesting projects that existed in the #nostr universe. Over time it became the go-to page for people to point newbies in the space and a place where builders published their new creations. Initially I was the one adding the…
There will be times when the struggle seems impossible. I know this already. Alone, unsure, dwarfed by the scale of the enemy. Remember this. Freedom is a pure idea. It occurs spontaneously and without instruction. Random acts of insurrection are occurring constantly throughout the galaxy. There are whole armies, battalions that have no idea that they’ve already enlisted in the cause.…
This started as a twitter thread that is now a long form article. In August 2021 a group of us who semi-regularly got together for beers and bitcoin-related discussions had a brilliant idea - why not make this a public event? Back then there weren’t any bitcoin meetups in our town Ljubljana and we weren’t sure if there will be lots of interest for it, but then again we were meeting…
I do freedom tech stuff. I rant about lightning. I build AI and bitcoin stuff. I want to combine all of these (minus the ranting) into something that pushes the quest for freedom one step forward. I build lots of MVP’s and do R&D for various companies. I also consult companies on Bitcoin, AI, nostr security and infrastructure. I’m working on several projects , most notably enclava.ai…
My public profiles: Twitter: @aaaljaz Github: aljazceru Nostr: aljaz@nostr.si In case you want to reach me via email use a@[domain you’re reading this on]. And if you’re really one of the wild ones here’s my PGP key fingerprint: “A5 E1 84 5C 24 34 67 29”
List of projects I’m working on, in no particular order: enclava.ai enclava.ai - Privacy AI platform for companies to build and deploy AI applications while keeping data private and secure. nostr.net there are multiple projects under nostr.net umbrella: nostr.net - A go to location for all things nostr. nostr.at - Nostr web gateway. nostr.eu - Nostr web gateway localized for EU users…
Bitcoin Atlantis 2024 - Sovereign engineering panel Bitcoin Rapid Fire: BoltObserver, Risks to Lightning, & The ‘Value Enabled Web’ w/ Aljaz Ceru The State of LN: Legends of Lightning Vol. 2
List of tools I’ve built and find useful, in no particular order: EurSat eursat.eu - Website to track performance of bitcoin vs euro. Ollama openrouter proxy ollama-openrouter-proxy - Ollama proxy that uses free models available on openrouter. Timeconvert.org timeconvert.org - Convert timestamps and dates into various formats, including Unix, ISO 8601, UTC, and more. RSS / Atom debugger…