nothing spectacular
Let s Stop Calling Everything “Linear Attention” If your “constant-time” attention still scans a million tokens, we need to talk. “Linear attention” is becoming the gluten-free of AI architecture terminology: everyone puts it on the label, nobody agrees what it means, read more
A modest proposal for saving scientific computing from typographic entropy. (This post is a summary of the discussion of rigorous performance notation and benchmarking methodology in our paper Scientific Benchmarking of Parallel Computing Systems (Section 2.1.2) and the common criminal read more
I am traveling to the US often enough that it pays off to have a local phone number. But I m not there often enough to have a monthly subscription. So AT T s prepaid ( pay as you go ) offering seemed like a read more
SPCL is back at SC after a forceful break last year where we could not submit because I was technical papers co-chair, we celebrate our comeback this year (with some backlog from las of course). The SPCL team will read more
This blog post purely reflects my personal opinions even though it happened during business travel on behalf of ETH, it has nothing to do with the university. Yet, one may assume that a professor of computer science is technically savy read more
Twelve ways to fool the masses when reporting performance of deep learning workloads Torsten Hoefler Due to it s wide-spread success in many hard machine learning tasks, deep learning quickly became one of the most important demanding compute workloads today. read more
The OFA just released a new Open Subnet Manager version (v3.3.21) for InfiniBand, including many interesting features: Support for HDR link speed and 2x link width New routing algorithm: Nue routing Support for ignoring of throttled links for Nue [1,2] read more
Just a brief overview of SPCL s (non-NDA) ongoing and upcoming activities at ISC 18. 1) We re in the middle of the Advanced MPI Tutorial With Antoni Pena from Barcelona Supercomputing Center, Tweet 2) Wednesday, 26.06., 11:15am, Talk: Automatic compiler-driven GPU acceleration read more
Disclaimer: This blog post is not binding for the SC18 submission process. It attempts to explain the background and history of the innovations. For authoritative answers regarding the process, authors MUST refer to the SC18 webpage and FAQ! What many read more
SC17 is over, and even though it was my 10th anniversary, it wasn t the best of the SC series. Actually, if you ask me personally, probably the worst but I promised to not discuss details here. Fortunately, I ll be tech read more