AIware 2025
Wed 19 - Thu 20 November 2025
co-located with ASE 2025

Computational notebooks have become the preferred tool of choice for data scientists and practitioners to perform analyses and share results. Notebooks uniquely combine scripts with documentation. With the emergence of generative AI (GenAI) technologies, it is increasingly important, especially in competitive settings, to distinguish the characteristics of human-written versus GenAI. Our new idea is to explore the strengths of both humans and GenAI through the coding and documenting activities in notebooks. We first characterize differences between 25 code and documentation features in human-written, medal-winning Kaggle notebooks. We find that gold medalists are primarily distinguished by longer and more detailed documentation. Second, we analyze the distinctions between human-written and GenAI notebooks. Our results show that while GenAI notebooks tend to achieve higher code quality (as measured by metrics like code smells and technical debt), human-written notebooks display greater structural diversity, complexity, and innovative approaches to problem-solving. Based on these early results, we highlight four agendas to further investigate how GenAI could be utilized in notebooks that maximize the potential collaboration between human and GenAI tech.

Wed 19 Nov

Displayed time zone: Seoul change

16:00 - 16:50
Human Factors and Organizational Perspectives in AIwareMain Track at Grand Hall 1
Chair(s): Hongyu Zhang Chongqing University
16:00
8m
Research paper
Examining the Usage of Generative AI Models in Student Learning Activities for Software Programming
Main Track
Rufeng Chen McGill University, Shuaishuai Jiang , Jiyun Shen , AJung Moon McGill University, Lili Wei McGill University
Pre-print
16:08
8m
Talk
Human to Document, AI to Code: Three Case Studies of Comparing GenAI for Notebook Competitions
Main Track
Tasha Settewong Nara Institute of Science and Technology, Youmei Fan Nara Institute of Science and Technology, Raula Gaikovina Kula The University of Osaka, Kenichi Matsumoto Nara Institute of Science and Technology
Pre-print
16:16
8m
Talk
Judge the Votes: A System to Classify Bug Reports and Give Suggestions
Main Track
Emre Dinc Bilkent University, Eray Tüzün Bilkent University
Pre-print
16:24
8m
Talk
Model-Assisted and Human-Guided: Perceptions and Practices of Software Professionals Using LLMs for Coding
Main Track
Italo Santos University of Hawai‘i at Mānoa, Cleyton Magalhaes Universidade Federal Rural de Pernambuco, Ronnie de Souza Santos University of Calgary
Pre-print
16:32
18m
Live Q&A
Joint Discussion #HumanInTheLoop
Main Track