Deepseek V4 Flash 0731 latency numbers from nine providers
DeepSeek V4 Flash 0731 is available from many inference providers, and I needed to evaluate which ones could handle our production traffic.
Oskari Mantere
Software and systems
Latest posts
30× faster binary multivector ColBERT late interaction in Vespa
A key advantage of Vespa against other search databases is the ease with which you can index multiple chunks of a long document in a multi-vector fashion. This is convenient in RAG applications as it allows your overall document score to be an arbitrary score of the individual chunk scores.
Reviving a four year old reMarkable 2
I found my old reMarkable 2 paper tablet, bought in 2021, it had sat unused for ~4 years or so. The device was in a sorry state:
Call stack diffs
Inspired by HumanLayer’s “Program Design” section in Why Software Factories Fail, I’ve recently added a permanent system instruction for coding agents to communicate all planned changes or implementations inline as call stack diffs: