I was talking with someone about learning and memory, and they reflected (with some disappointment) that it s the negative things we remember best. I ve been struggling with something similar with LLM memories, and thinking about the parallels gave me some insight into both: When pulling memories out of …
Generating poetry was among the first popular parlor tricks for an LLM . Poetry is appealing because it has the form of something carefully constructed, and yet plays into the LLM s abilities to join disparate elements: words, expression, rhyme, rhythm. Attending to each simultaneously challenges a human to create a …
This post is part of the series Creating worlds with LLMs Hidden Door , where roleplay meets fan fiction , is an LLM -driven collaborative storytelling game. It recently had its first public release. What follows is more tech review than a game review. I m certainly no game reviewer, but I …
Introduction This post is part of the series Creating worlds with LLMs Last year I participated in a text adventure hackathon to build a text-based game using AI . I d already been thinking about it but it was a great opportunity to put together those thoughts into something real. Since …
I ve been experimenting with using LLMs for worldbuilding and other generative/creative endevours. This post is a round-up of writing and videos related to that work. I do more work with LLMs that isn t as playful, but it s less visible and I write more about the playful …
Many years ago I was listening to a recording 1 by Alan Watts and he briefly mentioned Preta or The Hungry Ghost : Hungry or frustrated spirits who have enormous stomachs but mouths only the size of needles, a vast appetite and no means of fulfillment. And this is the manu …
I m pretty sure reading /r/AmItheAsshole is harmful to my psyche, and yet and yet why shouldn t I be able to participate in this collectively harmful behavior? I don t have good enough stories so I made ChatGPT write some r/AmItheAsshole • 30 minutes ago ConcernedMom29 AITA for …
I ve been making some experiments with roleplaying and LLMs (Large Language Models, such as ChatGPT). After a lot of coding I think it s time to step back and think about what I ve done and what I might want to do. This post is part of the series …
In my last post I described a city builder using GPT . I was planning on putting a pin in that work with the post, but the heart wants what the heart wants and I found myself returning to that work. This post is part of the series Creating worlds with …
I ve been doing lots of experiments with GPT , though I ve only written about one until now the more serious something is the harder it is to call it finished or identify the outcomes. Here I ll describe something a bit lighter: world building, or specifically city building, with …
Over two years ago I wrote Thoughts On Voice Interfaces , a scattering of ideas about voice interactions. Time has passed, I ve been working more on voice interfaces, and though products in the market have barely changed, I still have NEW THOUGHTS . Large Language Models I ve only been exploring …
making new string and list classes that call gpt3 under the hood so you can access elements beyond the final one. no more index errors! — shb (@himbodhisattva) December 24, 2022 Some ideas are dumb enough you just have to try them, so I introduce to you the Python library: Infinite …
There are many concerns about Mozilla right now, and reason to be concerned. While I am no longer with Mozilla, it’s still a place that supported me for many years; I believe in Mozilla and want the project to succeed. Mozilla s one product It’s not always clear …
While I m conflicted with the need to find a …
I ve had a lot of projects , and at this moment of reflection I thought I d look back through those that felt most meaningful, and which despite my excitement I ve also let go of. If there s a thread that connects them maybe I ll find it, or …
I ve been working on the Consumer Voice Products team in Mozilla for about a year now. My primary project has been Firefox Voice , but our mandate is larger. I still feel like a beginner in the area of voice, but I have developed some opinions. Many observations are the …
In Arnold Kling s The Three Languages Of Politics he argues that we don t all exist along some set of objective political axes, left and right, or even the classic two-dimensional spectrum (or even three dimensions ). Instead different groups use different axes, or different dichotomies, to look at the …
Making the claim users want control is the same as saying you don t know what users want, you don t know what is good, and you don t know what their goals are. I first started thinking about this during the debate over what would become the ACA . The …
Or: The Best Way To Do Something Is To At Least Try We all know the story: you can t make money on open source. Is it really true? I m thinking about this now because Mozilla would like to diversify its revenue in the next few years, and one …
I have been part of the Firefox Test Pilot team for several years. I had a long list of things I wanted to build. Some I didn t personally want to build, but I thought they were interesting ideas. I didn t get very far through this list at all …