Weekly-#25 AI infra and application

LLM Inference It’s a great milestone when I finish a mature and iterable project, even it’s still in the first stage. There’re plenty AI infra repositoreis and projects in github, but most of them are designed and developed for nvidia GPU, some of them are designed for AMD. LLM computation industry is a huge field and market, there’re also many domestic GPU brands in china. As a result, the work…