Cross Talk
Training a multiturn conversation model on a single GPU using Markov text generation and DeBERTa-based reranking.
Joseph Cooper's Blog
Technical articles on AI, software development, and technical strategy by Joseph Cooper - including insights on embedding models, semantic deduplication, and practical AI applications.
Latest posts
A* Pathfinding with Softmax
Using softmax, A* search can generate diverse candidates for use with test-time compute.
What Does AI Really Do?
What you really need to know as a user, not developer, of modern AI systems.
Resume Vibe Check
I've put an app online to check your resume with a GPT-wrapper simulator.
RAG-Shot Learning
Retrieval-based in-context learning (RetICL) improves LLM performance by retrieving relevant labeled examples during inference.
Prompting by Activation Maximization
Prompt synthesis with activation maximization achieves 95.9% on Yelp Review Polarity with Llama-3.2-1B and a 4-token prompt.
Semantic Deduplication
Benchmarking various models to find the best way to deduplicate factoids for AI applications.