Hi there, I'm Alessio Devoto š
- Applied Agent Research team at NVidia.
- šØāš Prev. PhD student in Data Science at Sapienza University of Rome supervised by Simone Scardapane.
- š“ó §ó ¢ó ³ó £ó “ó æ Prev. Visiting researcher at Edinburgh NLP with Pasquale Minervini
š¬ Research Interests
My work spans both Computer Vision and Natural Language Processing, with a focus on Efficient Training & Inference for Language and Vision Models, AI Interpretability and Adaptive & Conditional Computation methods.
Blog
I write about deep learning, AI efficiency, and interpretability on my blog. Check it out for tutorials and insights!
Beyond Research
- š Training as a certified Life & Business Coach with the International Coaching Federation
- šŖšø Former Erasmus student at Universidad Politecnica de Valencia, Spain
- šļø Classical languages enthusiast - I teach Ancient Greek and Latin to high school and college students
š Latest Publications
- Adaptive Computation Modules: Granular Conditional Computation For Efficient Inference (AAAI 2025)
- A Simple and Effective Lā Norm-Based Strategy for KV Cache Compression (EMNLP 2024)
- Q-Filters: Leveraging QK Geometry for Efficient KV Cache Compression (SLLM @ ICLR 2025)
- Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering (NAACL 2025)
- Mixture-of-Experts Graph Transformers for Interpretable Particle Collision Detection (2025)
For a complete list, see my Google Scholar profile.
š« Connect With Me
Feel free to check my website, or connect with me on social media: