Intuitions behind Attention in Neural Networks
If ReLU is a diode, attention is a transistor.
Abhay Kashyap
Abhay Kashyap. AI/ML engineer and researcher building AI agents for manufacturing and industry. PhD in NLP, recommender systems and knowledge bases. Previously Stitch Fix, Walmart Labs, South Park Commons.
Latest posts
Visual semantic search for a million NFTs with CLIP
A step-by-step guide to building a visual semantic search engine for NFTs using Alchemy, OpenAI's CLIP & Pinecone.
Concurrent downloads with Python using asyncio or thread pools
This shows how to download multiple files in parallel with Python using asyncio or thread pools.
Human-in-the-loop AI for wildlife camera trap annotation
A journey of building a simple AI-powered, human-in-the-loop system to manage wildlife camera trap images & annotations