How Programmers Spend Their Time

I submitted a tiny patch to flash attention. The necessary typing for the change takes less ten seconds, but the overall change took more than ten hours So where does the time go? It started when coworker had a bug where cudnn attention would crash randomly. We looked at his unreleased changes and concluded that […]