PANDALens: Towards AI-Assisted In-Context Writing on OHMD During Travels
While effective for recording and sharing experiences, traditional in-context writing tools are
relatively passive and unintelligent, serving more like instruments rather than companions …
relatively passive and unintelligent, serving more like instruments rather than companions …
Lisee: A headphone that provides all-day assistance for blind and low-vision users to reach surrounding objects
Reaching surrounding target objects is difficult for blind and low-vision (BLV) users, affecting
their daily life. Based on interviews and exchanges, we propose an unobtrusive wearable …
their daily life. Based on interviews and exchanges, we propose an unobtrusive wearable …
Cases: A cognition-aware smart eyewear system for understanding how people read
The process of reading has attracted decades of scientific research. Work in this field
primarily focuses on using eye gaze patterns to reveal cognitive processes while reading …
primarily focuses on using eye gaze patterns to reveal cognitive processes while reading …
Do smart glasses dream of sentimental visions? Deep emotionship analysis for eyewear devices
Emotion recognition in smart eyewear devices is valuable but challenging. One key
limitation of previous works is that the expression-related information like facial or eye …
limitation of previous works is that the expression-related information like facial or eye …
Can Large Language Models Be Good Companions? An LLM-Based Eyewear System with Conversational Common Ground
Developing chatbots as personal companions has long been a goal of artificial intelligence
researchers. Recent advances in Large Language Models (LLMs) have delivered a practical …
researchers. Recent advances in Large Language Models (LLMs) have delivered a practical …
Optimizing product placement for virtual stores
The recent popularity of consumer-grade virtual reality devices has enabled users to
experience immersive shopping in virtual environments. As in a real-world store, the …
experience immersive shopping in virtual environments. As in a real-world store, the …
Empowering Smart Glasses with Large Language Models: Towards Ubiquitous AGI
D Zhang, Y Li, Z He, X Li - Companion of the 2024 on ACM International …, 2024 - dl.acm.org
Smart glasses, augmented by advances in multimodal Large Language Models (LLMs), are
at the forefront of creating ubiquitous Artificial General Intelligence (AGI). This short literature …
at the forefront of creating ubiquitous Artificial General Intelligence (AGI). This short literature …
Unveiling causal attention in dogs' eyes with smart eyewear
Our goals are to better understand dog cognition, and to support others who share this
interest. Existing investigation methods predominantly rely on human-manipulated …
interest. Existing investigation methods predominantly rely on human-manipulated …
Demonstrating PANDALens: Enhancing Daily Activity Documentation with AI-assisted In-Context Writing on OHMD
We introduce PANDALens, a Proactive AI Narrative Documentation Assistant built on an
Optical See-Through Head-Mounted Display that transforms the in-context writing tool into …
Optical See-Through Head-Mounted Display that transforms the in-context writing tool into …
Stepping Into the Next Decade of Ubiquitous and Pervasive Computing: UbiComp and ISWC 2021
The 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing
(UbiComp 2021) took place from September 21–26 virtually, around the world; co-located …
(UbiComp 2021) took place from September 21–26 virtually, around the world; co-located …