In this paper, we discuss a number of issues related to the design of evaluation tests for
comparing interactive music systems for improvisation. Our testing procedure covers
rehearsal and performance environments, and captures the experiences of a
musician/participant as well as an audience member/observer. We attempt to isolate salient
components of system behavior, and test whether the musician or audience are able to
discern between systems with significantly different behavioral components. We report on …