Training a Small GPT-2 Model Under 20M Parameters
5 min guide to GPT-2 decoder intuition and training for practical tasks
Home on Sean Neilan
Recent content in Home on Sean Neilan
Latest posts
What I learned using local vision-language models to scrape target.com
Using a 2 billion local visual language llm coupled with playwright to identify and click on elements in a browser.
Typst Math Notebook
An interactive math notebook that runs entirely in your browser
A Tiny LLM That Calls Itself
A tiny local LLM writes code to scrape a website, then calls itself to summarize what it found.
Local Fine-Tuning LLM's without Sovereign AI and Software Freedom!
Train TinyLlama to know its favorite color using LoRA fine-tuning.
Replacing Pencil and Paper with Latex for Math
Can math be done without pencil and paper? Yes.
Hello World Python AWS Lambda
Step by step tutorial to create a AWS Python Lambda function.
About
I’m helping connect people to funding opportunities using AI at GrantPuma . Experience grantpuma.com Dec 2023 - Present V.P. of Engineering Management Full stack Devops AI/Machine Learning Technical writing getfliff.com May 2023 - Oct 2023 Senior Software Engineer Kafka Legacy python jockmkt.com January 2022 - May 2023 Senior Software Engineer Payments Gambling software Microservices…
Big Number Names
Compute the name of any number up to infinity. Type a number below to see its name. Source code on GitHub | Conway-Wechsler naming system reference
Grid Draw
Click on cells to toggle them on/off. This grid is rendered and managed entirely by Rust code compiled to WebAssembly. How It Works This interactive canvas demonstrates Rust compiled to WebAssembly using wasm-bindgen and web-sys to directly manipulate an HTML canvas element. All grid state and rendering logic runs in WASM - JavaScript only handles event forwarding.
Interests
I write software for work and for fun! I’m always interested in building new systems, big or small. Here is small sample of software I have recently constructed just for fun. Feel free to check it out! Grid Draw Interactive 32x32 grid canvas powered by Rust and WebAssembly Big Number Names Compute the name of any number up to infinity Art For All Text your first and last name to +1 (312)…
Snippets
I make a lot of code snippets to help me write software. This search bar indexes them with minisearch.js . Explore what I’ve written by typing anything below. Try “postgres” or “python”.
Typst Math Notebook
A live math notebook that lets you write and render equations using Typst syntax. Type in an equation, press the + button to duplicate it, then edit the copy to show your work. Use in place of pencil and paper for practicing math. Typst Syntax Reference Math Typst Fractions a/b or frac(a, b) Superscript x^2 Subscript x_1 Square root sqrt(x) Sum sum_(i=1)^n Integral integral_a^b Greek letters alpha…