PhD Dissertation Defense by HUYNH Nguyen Phan Sinh | Multimodal Mobile Sensing Systems for Physiological and Psychological Assessment

About The Talk

Monitoring human physiological and psychological condition plays a crucial role in smart personalized systems and applications. This is especially important in the mobile context where people are spending more time on their smartphone applications doing various activities such as working, social network, gaming, and studying. Knowing the psychological state and other contextual information (what user is doing under a certain circumstance), the systems can potentially provide with the adaptive user experience. Applications such as stress assessment, engagement measurement can help users not just to spend their time on the smartphone more efficiently but also to support more healthy living. This thesis demonstrates that it is possible to measure vital physiological signals (heart rate and heart rate variability) using sensors available on commodity smartphone, and to develop mobile sensing systems to assess psychological states that can be used for improving mobile user experience by (i) developing a core sensing technique that leverages front camera on smartphone to measure a set of cardiovascular signals; and (ii) combining mobile and wearable sensors to assess important psychological states in mobile context (e.g., emotion, engagement).

Speaker Biography

HUYNH Nguyen Phan Sinh is a Ph.D. candidate in the School of Information Systems, Singapore Management University, working in the area of mobile and ubiquitous computing. He received his bachelor degree in Computer Engineering from Ho Chi Minh University of Technology, Vietnam, in 2014. His current research focuses on developing mobile sensing systems for health-care and gaming applications.