Supporting Novices Author Audio Descriptions via Automatic Feedback
Speaker (s):
Rosiana NATALIE
PhD Candidate
School of Computing and Information Systems
Singapore Management University
|
|
Date:
Time:
Venue:
|
|
11 April 2023, Tuesday
1:00pm - 2:00pm
Meeting room 4.4, Level 4
School of Computing and
Information Systems 1,
Singapore Management University,
80 Stamford Road
Singapore 178902
Please register by 11 April 2023.
|
|
About the Talk
Audio descriptions (AD) make videos accessible to those who cannot see them. But many videos lack AD and remain inaccessible as traditional approaches involve expensive professional production. We aim to lower production costs by involving novices in this process. We present an AD authoring system that supports novices to write scene descriptions (SD)—textual descriptions of video scenes—and convert them into AD via text-to-speech. The system combines video scene recognition and natural language processing to review novice-written SD and feeds back what to mention automatically. To assess the effectiveness of this automatic feedback in supporting novices, we recruited 60 participants to author SD with no feedback human feedback and automatic feedback. Our study shows that automatic feedback improves SD’s descriptiveness, objectiveness, and learning quality, without affecting qualities like sufficiency and clarity. Though human feedback remains more effective, automatic feedback can reduce production costs by 45%.
This is a Pre-Conference talk for ACM CHI Conference on Human Factors in Computing Systems (CHI 2023).
About the Speaker
Rosiana NATALIE is a Ph.D. student in the School of Computing and Information Systems at Singapore Management University. She is working with Assistant Professor Kotaro HARA. Prior to joining the Ph.D. program, she received her Master of Science Degree from National Tsing Hua University, Taiwan, in 2018. Her research interest lies in the intersection of Accessibility, Collaborative work, and Human-Computer Interaction. Her current research focuses on exploring and designing a collaborative method that is cost- and time-effective to author scene descriptions for blind people.
