Pierce Freeman
684
posts
Time is money and if you look around most SF offices these days, people are spending more than half of their time just waiting for llm outputs (even with multi-tasking) If this ends up costing $5k a month I can see a lot of companies paying. $5k << (300k/12) salaries
Replying to @OpenAI
Based on the Cerebras earnings call, the biggest challenge to getting everyone access to this speed are the boring things: -more data centers - more power - manufacturing more boxes Chip allocation is actually the lowest on the list since they manufacture on less constrained

