2024.aiwareconf.org

Dates

Tracks

You're viewing the program in a time zone which is different from your device's time zone change time zone

09:00 - 10:30

Opening + Keynote1 + AIware VisionMain Track / Late Breaking Arxiv Track at Mandacaru
Chair(s): Dayi Lin Centre for Software Excellence, Huawei Canada

09:00

15m

Day opening

Welcome and opening

Main Track


09:15

45m

Keynote

Building AI Agents for Software Engineering Tasks

Main Track

Gustavo Soares Microsoft

10:00

5m

Paper

Automatic Programming vs. Artificial Intelligence

Main Track

James Noble Independent. Wellington, NZ

DOI

10:05

5m

Paper

Towards AI for Software Systems

Main Track

Nafise Eskandani ABB Corporate Research Center, Guido Salvaneschi University of St. Gallen

DOI

10:10

5m

Paper

Morescient GAI for Software Engineering

Late Breaking Arxiv Track

Marcus Kessel University of Mannheim, Colin Atkinson University of Mannheim

Pre-print

10:15

15m

Live Q&A

Session Q&A and topic discussions

Main Track


10:30 - 11:00

Coffee BreakFSE Social Events at Foyer

Coffee Break + Poster Presentations [Afternoon students]

10:30

30m

Coffee break

Break

FSE Social Events


11:00 - 12:30

Industry Talk1 + SE for AIwareLate Breaking Arxiv Track / Industry Statements and Demo Track / Main Track at Mandacaru
Chair(s): Andreas Zeller CISPA Helmholtz Center for Information Security

11:00

20m

Industry talk

Agents for Data Science: From Raw Data to AI-generated Notebooks Using LLMs and Code Execution

Industry Statements and Demo Track

Jiahao Cai Google

11:20

10m

Paper

Function+Data Flow: A Framework to Specify Machine Learning Pipelines for Digital Twinning

Main Track

Eduardo de Conto Nanyang Technological University; CNRS@CREATE, Blaise Genest IPAL - CNRS - CNRS@CREATE, Arvind Easwaran Nanyang Technological University

DOI Pre-print

11:30

10m

Paper

Green AI in Action: Strategic Model Selection for Ensembles in Production

Main Track

Nienke Nijkamp Delft University of Technology, June Sallou Delft University of Technology, Niels van der Heijden University of Amsterdam, Luís Cruz Delft University of Technology

DOI Pre-print

11:40

5m

Paper

Towards Responsible AI in the Era of Generative AI: A Reference Architecture for Designing Foundation Model based Systems

Late Breaking Arxiv Track

Qinghua Lu Data61, CSIRO, Liming Zhu CSIRO’s Data61, Xiwei (Sherry) Xu Data61, CSIRO, Zhenchang Xing CSIRO’s Data61; Australian National University, Jon Whittle CSIRO's Data61 and Monash University

Pre-print

11:45

5m

Paper

Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agents

Late Breaking Arxiv Track

Qinghua Lu Data61, CSIRO, Liming Zhu CSIRO’s Data61, Xiwei (Sherry) Xu Data61, CSIRO, Zhenchang Xing CSIRO’s Data61; Australian National University, Stefan Harrer CSIRO's Data61, Jon Whittle CSIRO's Data61 and Monash University

Pre-print

11:50

5m

Paper

Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agents

Late Breaking Arxiv Track

Yue Liu Data61, CSIRO, Sin Kit Lo CSIRO Data61, Qinghua Lu Data61, CSIRO, Liming Zhu CSIRO’s Data61, Dehai Zhao CSIRO's Data61, Xiwei (Sherry) Xu Data61, CSIRO, Stefan Harrer CSIRO's Data61, Jon Whittle CSIRO's Data61 and Monash University

Pre-print

11:55

35m

Live Q&A

Session Q&A and topic discussions

Main Track


12:30 - 14:00

12:30

90m

Lunch

Lunch

FSE Social Events


14:00 - 15:30

Industry Talk2 + Human AI ConversationMain Track / Industry Statements and Demo Track at Mandacaru
Chair(s): Qinghua Lu Data61, CSIRO

14:00

20m

Industry talk

AI Assistant in JetBrains IDE: Insights and Challenges

Industry Statements and Demo Track

Andrey Sokolov JetBrains Research

14:20

10m

Paper

Unveiling the Potential of a Conversational Agent in Developer Support: Insights from Mozilla’s PDF.js Project

Main Track

João Correia PUC-Rio, Morgan C. Nicholson University of São Paulo, Daniel Coutinho Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Caio Barbosa Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Marco Castelluccio Mozilla, Marco Gerosa Northern Arizona University, Alessandro Garcia Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Igor Steinmacher Northern Arizona University

DOI Pre-print

14:30

10m

Paper

From Human-to-Human to Human-to-Bot Conversations in Software Engineering

Main Track

Ranim Khojah Chalmers | University of Gothenburg, Francisco Gomes de Oliveira Neto Chalmers | University of Gothenburg, Philipp Leitner Chalmers | University of Gothenburg

DOI Pre-print

14:40

10m

Paper

RUBICON: Rubric-Based Evaluation of Domain-Specific Human AI Conversations

Main Track

Param Biyani Microsoft, Yasharth Bajpai Microsoft, Arjun Radhakrishna Microsoft, Gustavo Soares Microsoft, Sumit Gulwani Microsoft

DOI

14:50

5m

Paper

Unveiling Assumptions: Exploring the Decisions of AI Chatbots and Human Testers

Main Track

Francisco Gomes de Oliveira Neto Chalmers | University of Gothenburg

DOI

14:55

35m

Live Q&A

Session Q&A and topic discussions

Main Track


15:30 - 16:00

Coffee BreakFSE Social Events at Foyer

Coffee Break + Poster Presentations [Morning students]

15:30

30m

Coffee break

Break

FSE Social Events


16:00 - 18:00

Security and Safety + Round Table + Day1 ClosingMain Track / Late Breaking Arxiv Track at Mandacaru
Chair(s): Thomas Zimmermann Microsoft Research, Ahmed E. Hassan Queen’s University

16:00

5m

Paper

An AI System Evaluation Framework for Advancing AI Safety: Terminology, Taxonomy, Lifecycle Mapping

Main Track

Boming Xia CSIRO's Data61 & University of New South Wales, Qinghua Lu Data61, CSIRO, Liming Zhu CSIRO’s Data61, Zhenchang Xing CSIRO's Data61

DOI

16:05

5m

Paper

Measuring Impacts of Poisoning on Model Parameters and Embeddings for Large Language Models of Code

Main Track

Aftab Hussain University of Houston, Rafiqul Rabin University of Houston, Amin Alipour University of Houston

DOI

16:10

10m

Paper

A Case Study of LLM for Automated Vulnerability Repair: Assessing Impact of Reasoning and Patch Validation Feedback

Main Track

Ummay Kulsum North Carolina State University, Haotian Zhu Singapore Management University, Bowen Xu North Carolina State University, Marcelo d'Amorim North Carolina State University

DOI

16:20

5m

Paper

Trojans in Large Language Models of Code: A Critical Review through a Trigger-Based Taxonomy

Late Breaking Arxiv Track

Aftab Hussain University of Houston, Rafiqul Rabin University of Houston, Toufique Ahmed University of California at Davis, Bowen Xu North Carolina State University, Premkumar Devanbu UC Davis, Amin Alipour University of Houston

Pre-print

16:25

25m

Live Q&A

Session Q&A and topic discussions

Main Track


16:50

60m

Panel

Round Table

Main Track


17:50

10m

Day closing

Day 1 summary and closing

Main Track


09:00 - 10:30

Opening Day2 + Keynote2 + AIware for Domain-specific ApplicationsLate Breaking Arxiv Track / Main Track at Mandacaru
Chair(s): Jie M. Zhang King's College London

09:00

5m

Day opening

Opening for day 2

Main Track


09:05

45m

Keynote

Semantic-Aware AI: Elevating the Future of Software Development

Main Track

Baishakhi Ray Columbia University, New York; AWS AI Lab

09:50

10m

Paper

SolMover: Smart Contract Code Translation Based on Concepts

Main Track

Rabimba Karanjai University of Houston, Lei Xu Kent State University, Weidong Shi University of Houston

DOI

10:00

5m

Paper

The Art of Programming: Challenges in Generating Code for Creative ApplicationsAIware Best Vision Paper Award

Main Track

Michael Cook King’s College London

DOI

10:05

5m

Paper

Neuro-Symbolic Approach to Certified Scientific Software Synthesis

Main Track

Hamid Bagheri University of Nebraska-Lincoln, Mehdi Mirakhorli Rochester Institute of Technology, Mohamad Fazelnia University of Hawaii at Manoa, Ibrahim Mujhid University of Hawaii at Manoa, Md Rashedul Hasan University of Nebraska-Lincoln

DOI

10:10

5m

Paper

LLMs in the Heart of Differential Testing: A Case Study on a Medical Rule Engine

Late Breaking Arxiv Track

Erblin Isaku Simula Research Laboratory, and University of Oslo (UiO), Christoph Laaber Simula Research Laboratory, Hassan Sartaj Simula Research Laboratory, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Thomas Schwitalla Cancer Registry of Norway, Jan F. Nygård Cancer Registry of Norway

Pre-print

10:15

15m

Live Q&A

Session Q&A and topic discussions

Main Track


10:30 - 11:00

Coffee BreakFSE Social Events at Foyer

10:30

30m

Coffee break

Break

FSE Social Events


11:00 - 12:30

Industry Talk3 + AIware for CodeMain Track / Industry Statements and Demo Track at Mandacaru
Chair(s): Yiling Lou Fudan University

11:00

20m

Industry talk

AI-assisted User Intent Formalization for Programs: Problem and Applications

Industry Statements and Demo Track

Shuvendu K. Lahiri Microsoft Research

11:20

10m

Paper

Identifying the Factors That Influence Trust in AI Code CompletionACM SIGSOFT Distinguished Paper Award

Main Track

Adam Brown Google, Sarah D'Angelo Google, Ambar Murillo Google, Ciera Jaspan Google, Collin Green Google

DOI

11:30

10m

Paper

A Transformer-Based Approach for Smart Invocation of Automatic Code CompletionACM SIGSOFT Distinguished Paper Award

Main Track

Aral de Moor Delft University of Technology, Arie van Deursen Delft University of Technology, Mali Izadi Delft University of Technology

DOI

11:40

10m

Paper

Leveraging Machine Learning for Optimal Object-Relational Database Mapping in Software Systems

Main Track

Sasan Azizian University of Nebraska-Lincoln, Elham Rastegari Creighton University, Hamid Bagheri University of Nebraska-Lincoln

DOI

11:50

10m

Paper

Chain of Targeted Verification Questions to Improve the Reliability of Code Generated by LLMs

Main Track

Sylvain Kouemo Ngassom Polytechnique Montréal, Arghavan Moradi Dakhel Polytechnique Montreal, Florian Tambon Polytechnique Montréal, Foutse Khomh Polytechnique Montréal

DOI

12:00

30m

Live Q&A

Session Q&A and topic discussions

Main Track


12:30 - 14:00

12:30

90m

Lunch

Lunch

FSE Social Events


14:00 - 15:30

Industry Talk4 + AIware for Software Lifecycle ActivitiesMain Track / Industry Statements and Demo Track / Late Breaking Arxiv Track at Mandacaru
Chair(s): Filipe Cogo Centre for Software Excellence, Huawei Canada

14:00

20m

Industry talk

AI in Software Engineering at Google: Progress and the Path Ahead

Industry Statements and Demo Track

Satish Chandra Google, Inc

14:20

10m

Paper

A Comparative Analysis of Large Language Models for Code Documentation Generation

Main Track

Shubhang Shekhar Dvivedi IIIT Delhi, Vyshnav Vijay IIIT Delhi, Sai Leela Rahul Pujari IIIT Delhi, Shoumik Lodh IIIT Delhi, Dhruv Kumar Indraprastha Institute of Information Technology, Delhi

DOI

14:30

10m

Paper

AI-Assisted Assessment of Coding Practices in Modern Code Review

Main Track

Manushree Vijayvergiya Google, Malgorzata Salawa Google, Ivan Budiselic Google, Dan Zheng Google DeepMind, Pascal Lamblin Google, Marko Ivanković Google; Universität Passau, Juanjo Carin Google, Mateusz Lewko Google Inc, Jovan Andonov Google, Goran Petrović Google Inc, Danny Tarlow Google, Petros Maniatis Google DeepMind, René Just University of Washington

DOI

14:40

10m

Paper

The Role of Generative AI in Software Development Productivity: A Pilot Case Study

Main Track

Mariana Coutinho CESAR School, Lorena Marques CESAR School, Anderson Santos CESAR School, Marcio Dahia CESAR School, Cesar França CESAR School, Ronnie de Souza Santos University of Calgary

DOI

14:50

10m

Paper

Effectiveness of ChatGPT for Static Analysis: How Far Are We?

Main Track

Mohammad Mahdi Mohajer York University, Reem Aleithan York University, Canada, Nima Shiri Harzevili York University, Moshi Wei York University, Alvine Boaye Belle York University, Hung Viet Pham York University, Song Wang York University

DOI

15:00

5m

Paper

Addressing Compiler Errors: Stack Overflow or Large Language Models?

Late Breaking Arxiv Track

Patricia Widjojo The University of Melbourne, Christoph Treude Singapore Management University

Pre-print

15:05

25m

Live Q&A

Session Q&A and topic discussions

Main Track


15:30 - 16:00

Coffee BreakFSE Social Events at Foyer

15:30

30m

Coffee break

Break

FSE Social Events


16:00 - 18:00

Industry Talk5 + AIware challenge + Day2 ClosingIndustry Statements and Demo Track / Challenge Track / Main Track at Mandacaru
Chair(s): Mei Nagappan University of Waterloo, Tianyi Zhang Purdue University

16:00

20m

Industry talk

AI-Based Digital Twins: A Tale of Innovation in Norwegian Public Sectors

Industry Statements and Demo Track

Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University

16:20

5m

Other

Challenge Introduction

Challenge Track


16:25

10m

Talk

Investigating the Potential of Using Large Language Models for Scheduling

Challenge Track

Deddy Jobson Mercari, Li Yilin Mercari

DOI

16:35

10m

Talk

Automated Scheduling for Thematic Coherence in Conferences

Challenge Track

Mahzabeen Emu Queen’s University, Tasnim Ahmed Queen’s University, Salimur Choudhury Queen’s University

DOI

16:45

10m

Talk

Conference Program Scheduling using Genetic Algorithms

Challenge Track

Rucha Deshpande Purdue University, USA, Aishwarya Devi Akila Pandian Purdue University, Vigneshwaran Dharmalingam Purdue University

DOI

16:55

15m

Awards

Challenge Q&A, discussions, and winner announcement

Challenge Track


17:10

20m

Day closing

Day 2 closing

Main Track


18:00 - 19:30

TOSEM Editorial Board MeetingFSE Social Events at Pitanga
Chair(s): Mauro Pezze USI Università della Svizzera Italiana & SIT Schaffhausen Institute of Technology

18:00

90m

Meeting

TOSEM Editorial Board Meeting

FSE Social Events


Mon 15 Jul 2024 10:30 - 11:00 at Foyer - Coffee Break

Info for session

Coffee Break + Poster Presentations [Afternoon students]

Mon 15 Jul 2024 15:30 - 16:00 at Foyer - Coffee Break

Info for session

Coffee Break + Poster Presentations [Morning students]

Accepted Papers

Title
Automated Scheduling for Thematic Coherence in Conferences

Challenge Track

DOI
Conference Program Scheduling using Genetic Algorithms

Challenge Track

DOI
Investigating the Potential of Using Large Language Models for Scheduling

Challenge Track

DOI

Call for Challenge Papers

Overview

The 1st ACM International Conference on AI-powered Software will host an AI-augmented software (AIware) challenge. The AIware Challenge brings together researchers and practitioners who are interested in applying, comparing, and challenging their AI-based tools and approaches to a particular community-focused problem. For 2024, the challenge will centre around the creation of an AIware to create the program (aka schedule) of a conference.

Program creation is the process of taking all the accepted papers to a conference and allocating a presentation slot for each paper with parallel sessions. The PC chairs of a conference typically do this manually. Sample programs from the MSR conference can be seen below. Some of the constraints that make the creation of a program challenging are as follows:

Constraints:

  1. Total time for all presentations in a session cannot be longer than the length of the session.
  2. Total number of sessions has to be equal to the number of sessions provided by the PC chairs.
  3. If there are parallel tracks, then no two papers with common authors can be scheduled in parallel at the same time

When these constraints are met, the PC chairs optimize for the papers in a session to be on a similar topic and work to avoid the parallel scheduling of sessions with related topics. The input data sources for the challenge comprise the number of conference sessions, the length of each session, the number of parallel tracks, and the accepted papers in a particular conference along with all the corresponding data: title, topics, abstract, paper, authors and allocated time for the presentation of each paper. Authors of the AIware challenge can collect any other data related to the papers or the authors of those papers that they deem as suitable.

Data

The authors of the AIware challenge can get this data from past MSR’s here:

MSR 2023 program
MSR 2022 Program

Participation

Participating in the challenge is straightforward:

  1. Extract the data from 2023 and 2022 MSR conferences for testing. Use any data that you may want for training.
  2. Build your AIware that solves the program creation problem.
  3. Gather the results - discuss the differences with the human-generated program. Are they better or worse and why do you think so?
  4. Write up and submit your 2-page challenge report

Since the data from MSR is common, authors are encouraged to collaborate by sharing the extracted data. To facilitate and encourage the sharing of extracted data and early results, a dedicated Slack channel has been created for this:

Paper Details

The challenge report describes the results of your work. The reports should cover the following aspects:

  • What data was used as input?
  • Which AI model was used?
  • How did you finetune or train the model?
  • What is the architecture of your AIware solution?
  • What prompts were used to query if any?
  • What data did you use for training?
  • What was your result - discuss the differences with the human-generated program of MSR 2023 and 2022.
  • Were any hard constraints broken?
  • Lessons learned and challenges in building such AIware?

Submission guidelines

Reports should be at most 2 pages long and in ACM 2-column format. See main track for more details.

Review and evaluation process

See main track for more details.

Awards

Attendees at AIware will select the winner of the best challenge submission.

Furthermore, we encourage all challenge participants to make their tools available for program chairs of future SE conferences to use.

Report submission is at:

https://aiware24challenge.hotcrp.com/

Important Dates

  • All dates are 23:59:59 AoE (UTC-12h).
  • Paper submission: Apr 10th, 2024
  • Paper notification: May 10th, 2024
  • Paper camera-ready: May 17th, 2024
  • Conference dates: July 15th-16th, 2024

For more details send email to: mei.nagappan@uwaterloo.ca, tianyi@purdue.edu

Read the original on 2024.aiwareconf.org ↗