Prototyping machine learning through diffractive art practice

H Scurto, B Caramiaux, F Bevilacqua - Proceedings of the 2021 ACM …, 2021 - dl.acm.org
In this paper, we outline a diffractive practice of machine learning (ML) in the frame of
material-centered interaction design. To this aim, we review related work in ML, HCI, design …

Interactive machine learning of musical gesture

FG Visi, A Tanaka - Handbook of artificial intelligence for music …, 2021 - Springer
This chapter presents an overview of Interactive Machine Learning (IML) techniques applied
to the analysis and design of musical gestures. We go through the main challenges and …

Machine learning for musical expression: A systematic literature review

T Jourdan, B Caramiaux - New Interfaces for Musical Expression (NIME …, 2023 - hal.science
For several decades NIME community has always been appropriating machine learning
(ML) to apply for various tasks such as gesture-sound mapping or sound synthesis for digital …

InteractML: Making machine learning accessible for creative practitioners working with movement interaction in immersive media

C Hilton, N Plant, C Gonzalez Diaz, P Perry… - Proceedings of the 27th …, 2021 - dl.acm.org
Interactive Machine Learning offers a method for designing movement interaction that
supports creators in implementing even complex movement designs in their immersive …

Gesture-timbre space: Multidimensional feature mapping using machine learning and concatenative synthesis

M Zbyszyński, B Di Donato, FG Visi… - … Symposium on Computer …, 2019 - Springer
This chapter explores three systems for mapping embodied gesture, acquired with
electromyography and motion sensing, to sound synthesis. A pilot study using granular …

Designing gestures for continuous sonic interaction

A Tanaka, B Di Donato, M Zbyszynski, G Roks - 2019 - figshare.le.ac.uk
We present a system that allows users to try different ways to train neural networks and
temporal modelling to asso-ciate gestures with time-varying sound. We created a soft-ware …

[PDF][PDF] Webchuck: Computer music programming on the web

MR Mulshine, G Wang, J Atherton, C Chafe… - New Interfaces for …, 2023 - gewang.com
WebChucK is ChucK—a strongly-timed computer music programming language—running
on the web. Recent advancements in browser technology (including WebAssembly and the …

[PDF][PDF] Supporting Interactive Machine Learning Approaches to Building Musical Instruments in the Browser.

L McCallum, M Grierson - NIME, 2020 - nime.org
Interactive machine learning (IML) is an approach to building interactive systems, including
DMIs, focusing on iterative end-user data provision and direct evaluation. This paper …

User-centred design actions for lightweight evaluation of an interactive machine learning toolkit

F Bernardo, M Grierson, R Fiebrink - Journal of Science and …, 2018 - journals.ucp.pt
Abstract Machine learning offers great potential to developers and end users in the creative
industries. For example, it can support new sensor-based interactions, procedural content …

[PDF][PDF] Towards assisted interactive machine learning: exploring gesture-sound mappings using reinforcement learning

FG Visi, A Tanaka - ICLI 2020—the fifth international conference …, 2020 - federicovisi.com
We present a sonic interaction design approach that makes use of deep reinforcement
learning to explore many mapping possibilities between input sensor data streams and …