Joel Mackenzie on Joel Mackenzie
Recent content in Joel Mackenzie on Joel Mackenzie
Latest posts
When LLM Judges Inflate Scores: Exploring Overrating in Relevance Assessment
LLM-UP: SIGIR 2026 Workshop on LLM-powered User Profiling for Search and Recommendation
Simple Techniques for Efficient Top-$k$ Batch Query Processing
Fast, Compact, Immediate-Access Indexing for Learned Sparse Retrieval Systems
Practical, Efficient, In-Memory Inverted Indexes
Revisiting Human-vs-LLM judgments using the TREC Podcast Track
Report on the Agentic AI in Financial Services Workshop at AAAI 2026
Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challenges
ICTIR 2021
Our paper ERR is not C/W/L: Exploring the Relationship Between Expected Reciprocal Rank and Other Metrics has won the best paper award at ICTIR 2021!
Recruitment
Information for Prospective Students Please carefully read all of the following information before contacting me. Available Positions Currently, I do not have any funded positions open. However, there are positions available for one or more outstanding applicants who qualify for an international scholarship through UQ, or an Australian government Research Training Scholarship position. These…
Supervision
PhD Students Watheq Mansour (primary advisor, current): Efficient and Effective Data Augmentation Strategies for Information Retrieval. Daisuke Yukita (associate advisor, current): Human-centered Verification of Large Language Model Outputs. Farid Ariai (associate advisor, current): Towards Multi-Jurisdictional Legal NLP Systems. Pietro Bernardelle (associate advisor, current): Leveraging Personas…
Teaching
The University of Queensland I was the course coordinator and lecturer for COMP3506/COMP7505: Algorithms & Data Structures during semester 2, 2023, 2024, and 2025. In 2025, I co-lectured this course with Dr Joshua Arnold . I was the course coordinator and lecturer for CSSE7610: Concurrency: Theory and Practice with Brae Webb in semester 2, 2025. I was the course coordinator and lecturer for…
Service
Organisation I am a resources co-chair for SIGIR 2026 with Lorraine Goeuriot which will be held in Melbourne. I was a short paper co-chair for SIGIR 2025 with Ebrahim Bagheri and Faegheh Hasibi which was held in Padua, Italy. I was a program co-chair for ADCS 2022 with Maciek Rybinski which was held at Flinders University in Adelaide. Damiano Spina and I were the general chairs of ADCS 2021 which…
Trivia
I have collaborated with a number of people who are smarter than myself: Ahmed Hassan Awadallah Leif Azzopardi Daniel Beck Rodger Benham Roi Blanco Jamie Callan Chris Kamphuis Ruey-Cheng Chen Farhana Choudhury Charlie Clarke Matt Crane J. Shane Culpepper Zhuyun Dai Tadele Damessie Luke Gallagher Kshitiz Gupta Binsheng Liu Jimmy Lin Xiaolu Lu Xueguang Ma Craig Macdonald Antonio Mallia Alistair…