PocketVib, the first cost-effective smartphone-based laser speckle vibrometry system for multi-point kHz-frequency micro-vibration sensing, using built-in ToF and rolling shutter cameras.
HoloMobile, the first end-to-end mobile avatar system that reconstructs photorealistic dynamic human avatars from monocular smartphone video and streams them for real-time viewing on mobile devices.
CUHK-X, a large-scale multimodal dataset and benchmarks for human activity recognition, understanding, and reasoning, with tens of thousands of samples of 40 actions from 30 participants across seven sensor modalities.
CoHear, a collaborative system that leverages a network of earphones to model and enhance speech at the conversation level, using verbal and non-verbal cues to form groups and extract target speech.
ContextAgent, the first context-aware proactive agent that incorporates wearable sensory contexts so LLM agents can predict when help is needed and call tools unobtrusively.
AquaScan, the first scanning sonar-based underwater sensing system for human activity monitoring. To
overcome the low frame rate due to the sonar’s physical
limitation, we propose a novel scanning strategy and apply
an image reconstruction method to accelerate the scanning
speed without compromising the performance of motion
detection
SocialMind, the first LLM-based proactive AR social assistive system that provides users with in-situ social assistance. SocialMind employs human-like perception leveraging multi-modal sensors to extract both verbal and nonverbal cues, social factors, and implicit personas, incorporating these social cues into LLM reasoning for social suggestion generation.
Argus, a wearable add-on system based
on stripped-down (i.e., compact, lightweight, low-power, limitedcapability) mmWave radars. It is the first to achieve egocentric human mesh reconstruction in a multi-view manner. Compared with
conventional frontal-view mmWave sensing solutions, it addresses
several pain points, such as restricted sensing range, occlusion, and
the multipath effect caused by surroundings.
Argus, a wearable add-on system based
on stripped-down (i.e., compact, lightweight, low-power, limitedcapability) mmWave radars. It is the first to achieve egocentric human mesh reconstruction in a multi-view manner. Compared with
conventional frontal-view mmWave sensing solutions, it addresses
several pain points, such as restricted sensing range, occlusion, and
the multipath effect caused by surroundings.
Argus, a wearable add-on system based
on stripped-down (i.e., compact, lightweight, low-power, limitedcapability) mmWave radars. It is the first to achieve egocentric human mesh reconstruction in a multi-view manner. Compared with
conventional frontal-view mmWave sensing solutions, it addresses
several pain points, such as restricted sensing range, occlusion, and
the multipath effect caused by surroundings.