EyeFormer: predicting personalized scanpaths with transformer-guided reinforcement learning

Y Jiang, Z Guo, H Rezazadegan Tavakoli… - Proceedings of the 37th …, 2024 - dl.acm.org
From a visual-perception perspective, modern graphical user interfaces (GUIs) comprise a
complex graphics-rich two-dimensional visuospatial arrangement of text, images, and …

Graph4GUI: Graph Neural Networks for Representing Graphical User Interfaces

Y Jiang, C Zhou, V Garg, A Oulasvirta - Proceedings of the CHI …, 2024 - dl.acm.org
Present-day graphical user interfaces (GUIs) exhibit diverse arrangements of text, graphics,
and interactive elements such as buttons and menus, but representations of GUIs have not …

[HTML][HTML] AI in Context: Harnessing Domain Knowledge for Smarter Machine Learning

T Miller, I Durlik, A Łobodzińska, L Dorobczyński… - Applied Sciences, 2024 - mdpi.com
This article delves into the critical integration of domain knowledge into AI/ML systems
across various industries, highlighting its importance in developing ethically responsible …

Computational Representations for Graphical User Interfaces

Y Jiang - Extended Abstracts of the CHI Conference on Human …, 2024 - dl.acm.org
Graphical User Interfaces (GUIs) have been widely used in daily life. To enhance GUI
design and interaction experience on GUIs, it is important to understand GUIs and …