Toga: A neural method for test oracle generation

E Dinella, G Ryan, T Mytkowicz, SK Lahiri - Proceedings of the 44th …, 2022 - dl.acm.org
Testing is widely recognized as an important stage of the software development lifecycle.
Effective software testing can provide benefits such as bug finding, preventing regressions …

Fuzzing deep-learning libraries via automated relational api inference

Y Deng, C Yang, A Wei, L Zhang - Proceedings of the 30th ACM Joint …, 2022 - dl.acm.org
Deep Learning (DL) has gained wide attention in recent years. Meanwhile, bugs in DL
systems can lead to serious consequences, and may even threaten human lives. As a result …

Code generation tools (almost) for free? a study of few-shot, pre-trained language models on code

P Bareiß, B Souza, M d'Amorim, M Pradel - arXiv preprint arXiv …, 2022 - arxiv.org
Few-shot learning with large-scale, pre-trained language models is a powerful way to
answer questions about code, eg, how to complete a given code example, or even generate …

Can large language models write good property-based tests?

V Vikram, C Lemieux, J Sunshine, R Padhye - arXiv preprint arXiv …, 2023 - arxiv.org
Property-based testing (PBT), while an established technique in the software testing
research community, is still relatively underused in real-world software. Pain points in writing …

[PDF][PDF] Unifying the perspectives of nlp and software engineering: A survey on language models for code

Z Zhang, C Chen, B Liu, C Liao, Z Gong… - arXiv preprint arXiv …, 2023 - simg.baai.ac.cn
In this work we systematically review the recent advancements in code processing with
language models, covering 50+ models, 30+ evaluation tasks, 170+ datasets, and 700 …

Fuzzing class specifications

F Molina, M d'Amorim, N Aguirre - Proceedings of the 44th International …, 2022 - dl.acm.org
Expressing class specifications via executable constraints is important for various software
engineering tasks such as test generation, bug finding and automated debugging, but …

Towards more realistic evaluation for neural test oracle generation

Z Liu, K Liu, X Xia, X Yang - Proceedings of the 32nd ACM SIGSOFT …, 2023 - dl.acm.org
Unit testing has become an essential practice during software development and
maintenance. Effective unit tests can help guard and improve software quality but require a …

Neural-based test oracle generation: A large-scale evaluation and lessons learned

SB Hossain, A Filieri, MB Dwyer, S Elbaum… - Proceedings of the 31st …, 2023 - dl.acm.org
Defining test oracles is crucial and central to test development, but manual construction of
oracles is expensive. While recent neural-based automated test oracle generation …

Natural Language Processing-based Software Testing: A Systematic Literature Review

M Boukhlif, M Hanine, N Kharmoum, AR Noriega… - IEEE …, 2024 - ieeexplore.ieee.org
New approaches to software testing are required due to the rising complexity of today's
software applications and the rapid growth of software engineering practices. Among these …

Call me maybe: Using nlp to automatically generate unit test cases respecting temporal constraints

A Blasi, A Gorla, MD Ernst, M Pezzè - Proceedings of the 37th IEEE/ACM …, 2022 - dl.acm.org
A class may need to obey temporal constraints in order to function correctly. For example,
the correct usage protocol for an iterator is to always check whether there is a next element …