Auditory display in interactive science simulations: Description and sonification support interaction and enhance opportunities for learning

BJ Tomlinson, BN Walker, EB Moore - … of the 2020 CHI conference on …, 2020 - dl.acm.org
Proceedings of the 2020 CHI conference on human factors in computing systems, 2020dl.acm.org
Science simulations are widely used in classrooms to support inquiry-based learning of
complex science concepts. These tools typically rely on interactive visual displays to convey
relationships. Auditory displays, including verbal description and sonification (non-speech
audio), combined with alternative input capabilities, may provide an enhanced experience
for learners, particularly learners with visual impairment. We completed semi-structured
interviews and usability testing with eight adult learners with visual impairment for two audio …
Science simulations are widely used in classrooms to support inquiry-based learning of complex science concepts. These tools typically rely on interactive visual displays to convey relationships. Auditory displays, including verbal description and sonification (non-speech audio), combined with alternative input capabilities, may provide an enhanced experience for learners, particularly learners with visual impairment. We completed semi-structured interviews and usability testing with eight adult learners with visual impairment for two audio-enhanced simulations. We analyzed trends and edge cases in participants' interaction patterns, interpretations, and preferences. Findings include common interaction patterns across simulation use, increased efficiency with second use, and the complementary role that description and sonification play in supporting learning opportunities. We discuss how these control and display layers work to encourage exploration and engagement with science simulations. We conclude with general and specific design takeaways to support the implementation of auditory displays for accessible simulations.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果