I Wrote the Maths Refresher I Needed
Somewhere between an embedding model and a loss function, I noticed I was nodding along to mathematics I could no longer actually do.
Abdul Qabiz is a Developer, Web Technologist, FOSS Advocate, Entrepreneur, Dad, and Motorcycle Tourer. He is co-founder and CTO of Allies Interactive/Diziana; and in past he has worked for companies like Macromedia, Adobe, Yahoo!, Mixercast, Tata Interactive.
Somewhere between an embedding model and a loss function, I noticed I was nodding along to mathematics I could no longer actually do.
You can build a working semantic-search prototype in a weekend now. Pick an embedding model, push your documents through it, store the vectors, and watch “search by meaning” light up in a demo. It feels like magic the first time.
The bug that taught me the most respect for billing systems was the one where our website showed an invoice for a subscription the customer had already cancelled.
Most “RAG systems” I get shown are a vector database, an LLM, and a bit of hope. They demo beautifully. You ask a question, the right answer comes back, everyone nods. Then real users turn up and you find out retrieval was the whole game all along.
I recently realised that Mail.app on my Mac doesn’t show more than 10000 messages in Yahoo! Inbox. I thought, it could be issue with Mail.app, and I configued Thunderbird to download Yahoo! mails, and even Thunderbird couldn’t download more than 10000 messages.
The 2020 hasn’t started well, our world is going through a pandemic caused by a novel coronavirus (COVID-19).
The year 2019 is about to end. I haven’t written in this space for over an year. I thought, I will write a short entry to say “hello” to anyone who still visits this blog.
We tend to get in a comfort zone after scratching the surface, i.e. barely learning about anything.
Ok, I know I shouldn’t generalise things like that.
I have started using a Apple MacBook Pro 2017 (15 inch) around two weeks back.