AI Thrust Seminar | Harnessing Vibrations for Finger Interactions with Commodity Smartwatches

9:00am - 10:00am
Zoom Meeting ID: 964 4634 3264; Passcode: 125973

Vibrations convey rich information about interactions between people, objects, and environments. Exploiting ubiquitous sensors and machine learning, I have developed systems to sense, understand, and broker universal low volume vibrational interactions between people and the physical world. 

In this presentation, I will focus on using subtle human body vibrations to translate freestyle finger writing and typing for interaction with wearable computing devices such as smartwatches and smart glasses. Challenges addressed include difficulties collecting and labeling a large vibration dataset, filtering human activity noise from finger typing and writing vibration signals through signal processing, designing a novel adversarial neural network to overcome human variations including those of typing strength, writing style, hand shape, smartwatch wrist position, and finally adopting a recurrent neural aligner for enabling both continuous and discrete finger movement recognition.

I will also briefly discuss the capture of vibrations from buildings, robots, and environments for use in ubiquitous computing applications such as metaverse, robotic automation, smart health, smart home tech, and security and privacy. The mission of this research is to integrate human, cyber, and physical experiences into an intelligent world of vibrational interactions.

讲者/ 表演者:
Dr. Wenqiang (Winston) Chen
Postdoctoral Associate, MIT CSAIL

Wenqiang (Winston) Chen is a postdoctoral associate at MIT CSAIL. He received his PhD from the University of Virginia. His research lies at the intersection of Cyber-Physical Systems (CPS), ubiquitous and mobile sensing, and human-computer interaction (HCI). In particular, his research specializes in developing Vibrational Interaction (VibInt) systems to perceive and infer information from human bodies, robots, and environments through vibrations. VibInt has been proposed to advance a wide variety of research areas, such as wearable interactions, robotics, smart health, smart homes, privacy and security. He has published his research in various top conferences and journals (e.g., Mobicom, Ubicomp, and Transactions on Mobile Computing), obtained five patents, and won the IEEE SECON 2018 Best Paper Award, the ACM SenSys 2020 Best Demo Award and the ACM Mobicom 2022 S3 workshop Best Paper Award. (All as the first author) Winston is also a co-founder of VibInt AI, a startup working on wearable devices using VibInt technologies, and his research IPs have been used in thousands of commodity devices.

语言
英文
适合对象
教职员
公众
研究生
本科生
更多信息

Online Zoom Meeting: https://hkust.zoom.us/j/96446343264?pwd=R3J4RkcraGk2Y1N6dnlnZktIUE9adz09

Meeting ID: 964 4634 3264

Passcode: 125973

主办单位
Artificial Intelligence Thrust, HKUST(GZ)
新增活动
请各校内团体将活动发布至大学活动日历。