Building Your Own Product Copilot: Challenges, Opportunities, and Needs

C Parnin, G Soares, R Pandita, S Gulwani… - arXiv preprint arXiv …, 2023 - arxiv.org
A race is underway to embed advanced AI capabilities into products. These product copilots
enable users to ask questions in natural language and receive relevant responses that are …

Flakify: A black-box, language model-based predictor for flaky tests

S Fatima, TA Ghaleb, L Briand - IEEE Transactions on Software …, 2022 - ieeexplore.ieee.org
Software testing assures that code changes do not adversely affect existing functionality.
However, a test case can be flaky, ie, passing and failing across executions, even for the …

Empirically evaluating flaky test detection techniques combining test case rerunning and machine learning models

O Parry, GM Kapfhammer, M Hilton… - Empirical Software …, 2023 - Springer
A flaky test is a test case whose outcome changes without modification to the code of the test
case or the program under test. These tests disrupt continuous integration, cause a loss of …

A survey on how test flakiness affects developers and what support they need to address it

M Gruber, G Fraser - 2022 IEEE Conference on Software …, 2022 - ieeexplore.ieee.org
Non-deterministically passing and failing test cases, so-called flaky tests, have recently
become a focus area of software engineering research. While this research focus has been …

Evaluating features for machine learning detection of order-and non-order-dependent flaky tests

O Parry, GM Kapfhammer, M Hilton… - 2022 IEEE Conference …, 2022 - ieeexplore.ieee.org
Flaky tests are test cases that can pass or fail without code changes. They often waste the
time of software developers and obstruct the use of continuous integration. Previous work …

Rethinking software engineering in the era of foundation models: A curated catalogue of challenges in the development of trustworthy fmware

AE Hassan, D Lin, GK Rajbahadur, K Gallaba… - … Proceedings of the …, 2024 - dl.acm.org
Foundation models (FMs), such as Large Language Models (LLMs), have revolutionized
software development by enabling new use cases and business models. We refer to …

Predicting flaky tests categories using few-shot learning

A Akli, G Haben, S Habchi, M Papadakis… - arXiv preprint arXiv …, 2022 - arxiv.org
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …

Transforming test suites into croissants

Y Chen, A Yildiz, D Marinov… - Proceedings of the 32nd …, 2023 - dl.acm.org
Software developers often rely on regression testing to ensure that recent changes made to
the source code do not introduce bugs. Flaky tests, which non-deterministically pass or fail …

FlakyCat: Predicting flaky tests categories using few-shot learning

A Akli, G Haben, S Habchi… - 2023 IEEE/ACM …, 2023 - ieeexplore.ieee.org
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …

Uncovering the causes of emotions in software developer communication using zero-shot llms

MM Imran, P Chatterjee, K Damevski - Proceedings of the IEEE/ACM …, 2024 - dl.acm.org
Understanding and identifying the causes behind developers' emotions (eg, Frustration
caused by'delays in merging pull requests') can be crucial towards finding solutions to …