Recent content on ⌨️🤷🏻♂️📷
This blog post was written by me, a human (as evidenced by how long it takes to explain a simple idea). If you want to skip straight to the main idea, scroll to The Point . There is an old saying: make invalid states unrepresentable . Like all maxims in computer science, one could debate its usefulness . Maybe you read it and think: Yes! Exactly! Or maybe you read it and recall a time as a junior…
Three years ago, it seemed absolutely certain (to me at least) that LLMs would continue to get even better and better, and LLMs would soon power just about every digital experience in our lives. Only one of those turned out to be true. Three years later, LLMs are smarter than ever. They can reason, they can generate images and videos (either natively or with a bridge to another model).…
Trying simple tree-search techniques for LLM token sampling At its core, an LLM is a value function. Given a state (i.e. the current context, or input text), it scores all possible next actions (i.e. tokens). Therefore, it’s pretty simple to imagine the task of sampling tokens as a state-space exploration problem, where we use a tree data structure to map out the state space and explore it…
I’ve been very enthusiastically playing with guidance , a library from Microsoft that lets you compose prompts for LLMs, and interact with those LLMs programmatically in a very natural way. I plan on using it for my personal projects going forward. I’m excited because this library lets you build prompts the way you think about prompts. No more fussing around with Langchain. One issue…
In our world, we can do anything that we want to do here. Any old thing. - Bob Ross, The Joy Of Painting Season 29 Episode 1 Watching a vibrant Seattle sunset the other day, my imagination started running. The otherworldly hue of the sky evoked something from science fiction. The hazy orange-purple was mesmerizing. I envisioned a massive, alien object hovering over a long-abandoned Seattle, with a…
Prelude: e and e Quick, how many bytes make up the following line? No tricks, I promise. Hello! The correct answer is: 6. Or 7, if you want to be pedantic and include the newline, but let’s not. This is simple enough; this page is encoded as UTF-8, which implies 8-bits per ASCII character, or a byte per character. Let’s play again. How many bytes make up the following line? Hello!! Easy enough. 7.…
Step 1: The spark ignites Oooh, look at this cool person’s blog post that was posted on Hacker News… Why don’t I have cool, minimal blog like this? Step 2: Pick your theme Spend two hours browsing minimal Hugo themes until you find one that’s simple yet functional. Step 3: Simplify Why does this “simple” theme include google analytics, disqus, and javascript…
Hi. I’m Andy Salerno. I’m a software developer, currently building Copilot Studio at Microsoft. * Things that interest me: programming languages with strong guarantees 🦀, open source, street photography, coffee. Reach out Email: andysalerno at gmial dotcom (fix the obvious typo in the domain) Github is linked in the page header. * Views in this blog are my own and don’t reflect…