Xrbench: An extended reality (xr) machine learning benchmark suite for the metaverse

H Kwon, K Nair, J Seo, J Yik… - Proceedings of …, 2023 - proceedings.mlsys.org
Real-time multi-task multi-model (MTMM) workloads, a new form of deep learning inference
workloads, are emerging for applications areas like extended reality (XR) to support …

SCAR: Scheduling Multi-Model AI Workloads on Heterogeneous Multi-Chiplet Module Accelerators

M Odema, L Chen, H Kwon… - 2024 57th IEEE/ACM …, 2024 - ieeexplore.ieee.org
Emerging multi-model workloads with heavy models like recent large language models
significantly increased the compute and memory demands on hardware. To address such …

Power, performance, and image quality tradeoffs in foveated rendering

R Singh, M Huzaifa, J Liu, A Patney… - … Virtual Reality and …, 2023 - ieeexplore.ieee.org
Extended reality (XR) devices, including augmented, virtual, and mixed reality, provide a
deeply immersive experience. However, practical limitations like weight, heat, and comfort …

A Multi-Task Deep Learning Framework Integrating Segmentation and Reconstruction for Lensless Imaging

X Yin, H Yue, H Yue, M Zhang, K Li… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
As a new paradigm in computational imaging, lensless imaging holds promise for camera
miniaturization. However, lensless image reconstruction or segmentation for lensless …

DREAM: A Dynamic Scheduler for Dynamic Real-time Multi-model ML Workloads

S Kim, H Kwon, J Song, J Jo, YH Chen, L Lai… - Proceedings of the 28th …, 2023 - dl.acm.org
Emerging real-time multi-model ML (RTMM) workloads such as AR/VR and drone control
involve dynamic behaviors in various granularity; task, model, and layers within a model …

PipeOrgan: Efficient Inter-operation Pipelining with Flexible Spatial Organization and Interconnects

R Garg, H Kwon, E Qin, YH Chen, T Krishna… - arXiv preprint arXiv …, 2024 - arxiv.org
Because of the recent trends in Deep Neural Networks (DNN) models being memory-bound,
inter-operator pipelining for DNN accelerators is emerging as a promising optimization. Inter …

EyeCoD: Eye Tracking System Acceleration via FlatCam-Based Algorithm and Hardware Co-Design

H You, Y Zhao, C Wan, Z Yu, Y Fu, J Yuan, S Wu… - IEEE Micro, 2023 - ieeexplore.ieee.org
Eye tracking has become an essential human–machine interaction modality in virtual reality
(VR) and augmented reality (AR) applications requiring high throughput (eg, more than 240 …

BlissCam: Boosting Eye Tracking Efficiency with Learned In-Sensor Sparse Sampling

Y Feng, T Ma, Y Zhu, X Zhang - arXiv preprint arXiv:2404.15733, 2024 - arxiv.org
Eye tracking is becoming an increasingly important task domain in emerging computing
platforms such as Augmented/Virtual Reality (AR/VR). Today's eye tracking system suffers …

BOXR: Body and head motion Optimization framework for eXtended Reality

Z Zhang, Z Li, H Kim, C Liu - 2024 IEEE Real-Time Systems …, 2024 - ieeexplore.ieee.org
The emergence of standalone Extended Reality (XR) systems has enhanced user mobility,
accommodating both subtle, frequent head motions and substantial, less frequent body …

Hardware/Software Co-Design Methodologies for Efficient AI Systems and Applications

MMAA Odema - 2024 - search.proquest.com
The landscape of AI research is dominated by the search for powerful deep learning models
and architectures that enable fascinating applications from the edge to the cloud. Indeed, we …