exploring, experimenting, investing

• Pinned

  

  a peak inside the inner workings of math ai

  

  00:00

  

  Some more details on our work

  @HarmonicMath

  : arxiv.org/abs/2510.01346 By the way, we’re hiring Research Engineers. This is a high-leverage opportunity to join a small and world-class team. High agency is required. DM me leads

• 

  Wrote this last February after seeing a demo of TTT being applied to video. markkim.bearblog.dev/test-time-trai… Test-time training shifts compute from pre-training to adaptation at inference. It handles distribution shifts more efficiently and amortizes training cost across the model's

  

  00:00

  

  ‼️huge ssi news. ilya is about to take his first tentative steps out of the age of research and back into the age of scale. it’s time to smell what ssi is cooking. ssi have built a small reasoning engine that can compete with much larger training runs because his data is

• 

  Something interesting that I learned today. TPUs will naturally struggle with training Kimi K3 and other linear architectures due to the mismatch in runtime between the MXU and VPU. The MXU needs to wait for the sequential vector work from the VPU before running the matrix

• 

  The Helios rack is gonna be insane when it comes out. Meta's engineers are on site helping design it Anthropic will help with mega kernels xAI has already deployed AMD chips with expert parallelism and RL workflows

  

  Exclusive: Advanced Micro Devices and Anthropic have signed a deal for tens of billions of dollars’ worth of artificial-intelligence servers, strengthening AMD’s competitive position against Nvidia wsj.visitlink.me/IQPuOi

• 

  Mathematizing new areas and being able to do so cheaply is one of the most exciting futures for AI. Neural networks can become the substrate to capture complex phenomenon. Humans may not understand the data, but AI will pick up on subtle patterns that's captured in its weights.

  

  Replying to @nasqret

  Most existing math will be properly analyzed and digested soon by AI. The next step will be the mathematization of new domains. When the mathematical abilities of AI are much more sophisticated, cheaper, and faster, it will be able to capture domains that are too complicated