A meta-summary of challenges in building products with ml components–collecting experiences from 4758+ practitioners

N Nahar, H Zhang, G Lewis, S Zhou… - 2023 IEEE/ACM 2nd …, 2023 - ieeexplore.ieee.org
Incorporating machine learning (ML) components into software products raises new
software-engineering challenges and exacerbates existing ones. Many researchers have …

On the design of ai-powered code assistants for notebooks

AM McNutt, C Wang, RA Deline… - Proceedings of the 2023 …, 2023 - dl.acm.org
AI-powered code assistants, such as Copilot, are quickly becoming a ubiquitous component
of contemporary coding contexts. Among these environments, computational notebooks …

Collaboration challenges in building ml-enabled systems: Communication, documentation, engineering, and process

N Nahar, S Zhou, G Lewis, C Kästner - Proceedings of the 44th …, 2022 - dl.acm.org
The introduction of machine learning (ML) components in software projects has created the
need for software engineers to collaborate with data scientists and other specialists. While …

What's wrong with computational notebooks? Pain points, needs, and design opportunities

S Chattopadhyay, I Prasad, AZ Henley… - Proceedings of the …, 2020 - dl.acm.org
Computational notebooks-such as Azure, Databricks, and Jupyter-are a popular, interactive
paradigm for data scientists to author code, analyze data, and interleave visualizations, all …

How data scientists use computational notebooks for real-time collaboration

AY Wang, A Mittal, C Brooks, S Oney - … of the ACM on Human-Computer …, 2019 - dl.acm.org
Effective collaboration in data science can leverage domain expertise from each team
member and thus improve the quality and efficiency of the work. Computational notebooks …

Symphony: Composing interactive interfaces for machine learning

A Bäuerle, ÁA Cabrera, F Hohman, M Maher… - Proceedings of the …, 2022 - dl.acm.org
Interfaces for machine learning (ML), information and visualizations about models or data,
can help practitioners build robust and responsible ML systems. Despite their benefits …

Operationalizing machine learning: An interview study

S Shankar, R Garcia, JM Hellerstein… - arXiv preprint arXiv …, 2022 - arxiv.org
Organizations rely on machine learning engineers (MLEs) to operationalize ML, ie, deploy
and maintain ML pipelines in production. The process of operationalizing ML, or MLOps …

Slide4n: Creating presentation slides from computational notebooks with human-ai collaboration

F Wang, X Liu, O Liu, A Neshati, T Ma, M Zhu… - Proceedings of the 2023 …, 2023 - dl.acm.org
Data scientists often have to use other presentation tools (eg, Microsoft PowerPoint) to
create slides to communicate their analysis obtained using computational notebooks. Much …

How do data analysts respond to ai assistance? a wizard-of-oz study

K Gu, M Grunde-McLaughlin, A McNutt, J Heer… - Proceedings of the CHI …, 2024 - dl.acm.org
Data analysis is challenging as analysts must navigate nuanced decisions that may yield
divergent conclusions. AI assistants have the potential to support analysts in planning their …

B2: Bridging code and interactive visualization in computational notebooks

Y Wu, JM Hellerstein, A Satyanarayan - Proceedings of the 33rd Annual …, 2020 - dl.acm.org
Data scientists have embraced computational notebooks to author analysis code and
accompanying visualizations within a single document. Currently, although these media …