Text embedding inference on a cheap server
Testing embedding models inference on cheap VPS
paulw.tokyo
Paul's blog
Latest posts
Plant based meat options in Japan
Testing some animal meat alternatives available in Japan
Standalone python script with uv
Uv is a neat package manager, which took off last year in python land. Being written in Rust™ immediately gives it +100 street credibility. As it supports reading inline script metadata (see PEP 723 ) it's easy to write scripts that specify their own dependencies, in a single file. You still need to install uv itself though, and while it's simple it's still an extra step, which is exactly one too…
Ad sharks
I don't own a TV, but there's one at my gym. This morning, there was this... infomercial? I don't know how to call it, it lasted at least an hour and had the tone of the usual off-hour Japanese TV. Programs that try, not very hard, to be both entertainment and journalistic news. Of course it was interspaced by plenty of ads. The topic was shark fishing, and how eating them keeps you young. And all…
Real-time semantic search demo
TLDR : I wanted to make a fast and low complexity "search engine", and got good results with neural network embeddings combined with an approximate vector search. Recent advances in large deep learning models have brought interesting multi-modal capabilities, notably for combined text and images, like Imagen and DALL-E 2 for image synthesis from raw text. CLIP , which is also used in DALL-E for…
Denormal number at inference in PyTorch
The other day at work I noticed a slowdown in runtime between a model with random weights compared to tuned ones. It turned out to be due to denormal numbers computation on the cpu being much slower than the normal arithmetic. Denormal numbers are very low magnitude floats, treated differently to keep precision. For deep learning, those are largely below significance and can be flushed to zero…
Basic watermark removal in videos
The general problem of completing images and videos depending on a mask is called inpainting , and numerous methods exists to tackle this problem in ingenuous ways . However most approaches are relatively costly to run, especially without a graphic card, so I wanted to see what result we could get with simple and fast methods. You can find the code for the steps below in this repository . To…
Space filling curves and CNN
👷🏻 this is a work in progress 🔧 Sometimes by exploring incongruous ideas, one can make interesting discoveries. This is known as serendipity in science, with penicillin being a famous example of an unplanned discovery. What I experimented with this week-end… is no such case. 😅 In the spirit of not holding back negative results though, and for the unlikely possibility that it turns out helpful…
Creating a static blog, the convoluted way
TLDR: I wanted to create a static blog while being able to type articles from a nice UI, from anywhere. It is quite straightforward with forestry + hugo + github pages . Jump to the solution. Motivation If you're looking to create a blog, you're in luck! There are countless tools to help you get up and running in a few minutes. For example Hugo will generate a static site from a few markdown…