Machine/deep learning for software engineering: A systematic literature review

S Wang, L Huang, A Gao, J Ge, T Zhang… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Since 2009, the deep learning revolution, which was triggered by the introduction of
ImageNet, has stimulated the synergy between Software Engineering (SE) and Machine …

Object detection for graphical user interface: Old fashioned or deep learning or a combination?

J Chen, M Xie, Z Xing, C Chen, X Xu, L Zhu… - proceedings of the 28th …, 2020 - dl.acm.org
Detecting Graphical User Interface (GUI) elements in GUI images is a domain-specific object
detection task. It supports many software engineering tasks, such as GUI animation and …

Unblind your apps: Predicting natural-language labels for mobile gui components by deep learning

J Chen, C Chen, Z Xing, X Xu, L Zhu, G Li… - Proceedings of the ACM …, 2020 - dl.acm.org
According to the World Health Organization (WHO), it is estimated that approximately 1.3
billion people live with some forms of vision impairment globally, of whom 36 million are …

UIED: a hybrid tool for GUI element detection

M Xie, S Feng, Z Xing, J Chen, C Chen - … of the 28th ACM Joint Meeting …, 2020 - dl.acm.org
Graphical User Interface (GUI) elements detection is critical for many GUI automation and
GUI testing tasks. Acquiring the accurate positions and classes of GUI elements is also the …

Wireframe-based UI design search through image autoencoder

J Chen, C Chen, Z Xing, X Xia, L Zhu… - ACM Transactions on …, 2020 - dl.acm.org
UI design is an integral part of software development. For many developers who do not have
much UI design experience, exposing them to a large database of real-application UI …

Owl eyes: Spotting ui display issues via visual understanding

Z Liu, C Chen, J Wang, Y Huang, J Hu… - Proceedings of the 35th …, 2020 - dl.acm.org
Graphical User Interface (GUI) provides a visual bridge between a software application and
end users, through which they can interact with each other. With the development of …

Guigan: Learning to generate gui designs using generative adversarial networks

T Zhao, C Chen, Y Liu, X Zhu - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
Graphical User Interface (GUI) is ubiquitous in almost all modern desktop software, mobile
applications and online websites. A good GUI design is crucial to the success of the software …

It takes two to tango: Combining visual and textual information for detecting duplicate video-based bug reports

N Cooper, C Bernal-Cárdenas… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
When a bug manifests in a user-facing application, it is likely to be exposed through the
graphical user interface (GUI). Given the importance of visual information to the process of …

Nighthawk: Fully automated localizing ui display issues via visual understanding

Z Liu, C Chen, J Wang, Y Huang, J Hu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Graphical User Interface (GUI) provides a visual bridge between a software application and
end users, through which they can interact with each other. With the upgrading of mobile …

Gifdroid: Automated replay of visual bug reports for android apps

S Feng, C Chen - Proceedings of the 44th International Conference on …, 2022 - dl.acm.org
Bug reports are vital for software maintenance that allow users to inform developers of the
problems encountered while using software. However, it is difficult for non-technical users to …