In the last year, language models have gotten cheaper and faster at the same time . This has led to a situation where we have a proliferation of answer interfaces in a lot of existing apps like Reddit in addition to the standalone apps that focus on giving you answers like Google, ChatGPT or Perplexity. Someone looking for information can easily open any one of these apps, type in a topic and get…
If you are anything like me, you spend a lot of time reading through the posts and discussions on the front page of Hacker News each day. Sometimes even after spending an hour or more on Hacker News, I come out with a sense that I haven’t fully caught up on the posts or the discussions. For the uninitiated, Hacker News is a site that aggregates news and blogs about tech, science and innovation…
As a continuation of my previous blog post , I was looking for good examples to further explore Envoy’s extension points. During this search, I found an issue on Github asking for a native Envoy Filter to do API Key Validation. I am not very familiar with Envoy’s native C++ filters but, as things stand today, we can already solve this problem using a Lua HTTP Filter. This post will…
Envoy offers a of variety in HTTP filters and you can do a lot with what comes out of the box like Header Mutation filter or gRPC-HTTP Transcoding . While this is great, there are certain circumstances where we need some additional customizations. To solve this issue, Envoy provides options like Lua HTTP Filter, Wasm Filter or the ExtProc Filter. Through these filters, you can write custom code in…