Automatic deictic gestures for animated pedagogical agents

SRK Kappagantula, N Adamo-Villani… - IEEE Transactions …, 2019 - ieeexplore.ieee.org
IEEE Transactions on Learning Technologies, 2019ieeexplore.ieee.org
We present a system that automatically generates deictic gestures for animated pedagogical
agents (APAs). The system takes audio and text as input, which define what the APA has to
say, and generates animated gestures based on a set of rules. The automatically generated
gestures point to the exact locations of elements on a whiteboard nearby the APA, which are
calculated by searching for keywords mentioned in the speech. We conducted a study with
100 subjects, in which we compared lecture videos containing gestures automatically …
We present a system that automatically generates deictic gestures for animated pedagogical agents (APAs). The system takes audio and text as input, which define what the APA has to say, and generates animated gestures based on a set of rules. The automatically generated gestures point to the exact locations of elements on a whiteboard nearby the APA, which are calculated by searching for keywords mentioned in the speech. We conducted a study with 100 subjects, in which we compared lecture videos containing gestures automatically-scripted by the system to videos of the same lecture containing manually-scripted gestures. The study results show that the manually-scripted and automatically-scripted lectures had comparable number of gestures, and that the gestures were timed equally well.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果