| |
 Designing Unvoiced Interfaces for Silent, Secure, and Intuitive Interactions Speaker (s):
Shubham Jain
Assistant Professor,
Stony Brook University - Computer Science
| Date: Time: Venue: | | 20 January 2025, Monday 2:00pm – 3:00pm School of Computing &
Information Systems 1 (SCIS 1)
Level 4, Meeting Room 4-4
Singapore Management University
80 Stamford Road,
Singapore 178902 Please register by 19 January 2025. We look forward to seeing you at this research seminar. 
|
|
About the Talk In this talk, I will introduce a series of cutting-edge systems that leverage jaw motion to enable unvoiced interaction, a paradigm designed to overcome the limitations of voice-based technologies in noisy or privacy-sensitive environments. We begin with MuteIt, an innovative ear-worn device that tracks jaw movement using twin IMUs to recognize unvoiced human commands. MuteIt breaks down jaw motion into constituent syllables and phonemes to recognize single word commands, outperforming traditional voice assistants in challenging acoustic environments. Next, we explore Jawthenticate, an earable system that authenticates users based on jaw motion through inaudible speech recognition without microphones, resistant to both vocal imitations and replay attacks. Finally, I will present Unvoiced, which transforms jaw motion signals into audio spectrograms for silent interaction with devices supporting multiple applications. Together, these systems pave the way for a new era of voiceless interactions, enhancing accessibility, privacy, and user convenience in diverse settings. About the Speaker Shubham Jain is an Assistant Professor in the Department of Computer Science at Stony Brook University where she leads PiCASSo (Pervasive Computing and Smart Sensing) Lab. Her research interests lie in cyber-physical systems, accessibility, and data analytics in smart environments. She is an NSF CAREER awardee and was also recognized as a rising star in networking and communication. She frequently publishes in top-tier venues. Her work on pedestrian safety has been featured in several media outlets, including The Wall Street Journal. She received her PhD in Electrical & Computer Engineering from Rutgers University in 2017. |
