The Problem That Keeps Finding Me
ML has always been hungrier than the infrastructure of it's time. Fifteen years, four products, one problem that keeps finding me and how that itch led to Neurafewz
Blog | Anubhab Bandyopadhyay
Recent content on Blog | Anubhab Bandyopadhyay
Latest posts
GPU Poverty and the Escape to 'Framework-less'
What happens when you run a multi-model agentic pipeline on a single GPU — and why none of the existing frameworks helped.
From 'Very Fast' to '~Fastest': Helping rust unleash compiler optimizations
A journey to supercharge Rust's text-diff performance through compiler optimization tricks.
Part 5: Desktop App for Document QA with RAG - Techniques
A DIY style step-by-step guide to building your own cutting-edge GenAI-powered document QA desktop app with RAG. In this part 5 and final instalment of this series we evaluate and implement some RAG techniques for better search results.
Part 4: Desktop App for Document QA with RAG - Indexing and Search
A DIY style step-by-step guide to building your own cutting-edge GenAI-powered document QA desktop app with RAG. In Part 4 we conclude the Indexing and a basic Search flow.
Part 3: Desktop App for Document QA with RAG - Document Layout Analysis, Text Extraction and Generation
A DIY style step-by-step guide to building your own cutting-edge GenAI-powered document QA desktop app with RAG. In Part 3, we focus on a Document Layout Analysis and extraction pipeline.
Part 2: Desktop App for Document QA with RAG - Vector Storage
A DIY style step-by-step guide to building your own cutting-edge GenAI-powered document QA desktop app with RAG. In Part 2 of this series we create our own mini Vector Store.
Part 1: Desktop App for Document QA with RAG - Generating Embeddings
A DIY style step-by-step guide to building your own cutting-edge GenAI-powered document QA desktop app with RAG. In Part 1 of this series, we implement a system to generate text Embeddings.
WASM: The `What`, `When` and `How`
In this post we are going to touch upon the what is WebAssembly and dive deep into when and how to use it by creating a toy text-diff application.
Part II: Voice Assistant Desktop App with LLaMA3 and Whisper in Rust
Step by step tutorial on building a desktop app to interface with LLM LLaMA3 with text and audio instructions in Rust. This is the 2nd and final installment of the series.
Part I: Voice Assistant Desktop App with LLaMA3 and Whisper in Rust
Step by step tutorial on building a desktop app to interface with LLM LLaMA3 with text and audio instructions in Rust
Part III: Desktop QA Assistant With Meta LLaMA3 in Rust
Building a desktop native app to interface with a local LLaMA3 8B in Rust using Tauri and Llama.cpp, step-by-step. In this final post of the series we tie everything together and get our app ready to roll!
Part II: Desktop QA Assistant With Meta LLaMA3 in Rust
Building a desktop native app to interface with a local LLaMA3 8B in Rust using Tauri and Llama.cpp, step-by-step. We'll load the model and get our backend ready for inference.
Part I: Desktop QA Assistant With Meta LLaMA3 in Rust
Building a desktop native app to interface with a local LLaMA3 8B in Rust using Tauri and Llama.cpp, step-by-step. We'll complete our project setup in this post.
Suckerpunched by 'Productivity Awareness' - an Entrepreneur's experience
A personal story of navigating productivity-awareness
7 Design Thinking Tips to Build Habit Forming Products
In my last blog I chronicled the roadblock we faced while building our app. A well-structured design thinking approach helped us in freezing the features, UI, UX and backend of the first version of Augment app. Reuven Cohen rightly point out in this article that, “design thinking” is a a human-centered, prototype-driven process for innovation that can be applied to product, service, and business…
4 Common Mistakes Founders Make While Building a Product
Life is too short for a bad software! — Balsamiq I love good products, cool and sexy tech that does magic! I admire and adore their creators but criticize the not-so-great ones all the time. Fortunately, the entire team that I work with shares the same degree of enthusiasm towards tech products as I do. Often, when we are not working on our product or while having an idle coffee we end up talking…