PhD Dissertation Proposal by HUYNH Nguyen Phan Sinh | Multimodal Mobile Sensing Systems for Physiological and Psychological Assessment

About The Talk

Monitoring human physiological and psychological condition plays a crucial role in smart personalized systems and applications. This is especially important in the mobile context where people are spending more time on their smartphone applications doing various activities such as social network, working, gaming, studying. Knowing the psychological state and other contextual information (what user is doing under a certain circumstance), the systems can potentially provide with the adaptive user experience. Applications such as stress assessment, engagement measurement can help users not just to spend their time on the smartphone more efficiently but also to support more healthy living. This thesis demonstrates that it is possible to measure vital physiological signals (heart rate variability and blood pressure) using sensors available on commodity smartphone, and to develop mobile sensing systems to assess psychological states that can be used for improving mobile user experience by (1) developing a core sensing technique that leverages front camera on smartphone to measure a set of cardiovascular signals; (2) combining mobile and wearable sensors to assess important psychological states in mobile context (e.g., emotion, engagement); and (3) optimizing user experience in mobile gaming, advertising, and online learning based on the measured states.

Speaker Biography

Huynh Nguyen Phan Sinh is a Ph.D. candidate in the School of Information Systems, Singapore Management University, working in the area of mobile and ubiquitous computing. He received his bachelor degree in Computer Engineering from Ho Chi Minh University of Technology, Vietnam, in 2014. His current research focuses on developing mobile sensing systems for health-care and gaming applications.