Simulation-driven automated end-to-end test and oracle inference

S Tuli, K Bojarczuk, N Gucevska… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
This is the first work to report on inferential testing at scale in industry. Specifically, it reports
the experience of automated testing of integrity systems at Meta. We built an internal tool …

Commit-aware mutation testing

W Ma, T Laurent, M Ojdanić, TT Chekam… - 2020 IEEE …, 2020 - ieeexplore.ieee.org
In Continuous Integration, developers want to know how well they have tested their
changes. Unfortunately, in these cases, the use of mutation testing is suboptimal since …

A conceptual replication of continuous integration pain points in the context of Travis CI

DG Widder, M Hilton, C Kästner… - … of the 2019 27th acm joint …, 2019 - dl.acm.org
Continuous integration (CI) is an established software quality assurance practice, and the
focus of much prior research with a diverse range of methods and populations. In this paper …

Exploring the mysteries of system-level test

I Polian, J Anders, S Becker, P Bernardi… - 2020 IEEE 29th …, 2020 - ieeexplore.ieee.org
System-level test, or SLT, is an increasingly important process step in today's integrated
circuit testing flows. Broadly speaking, SLT aims at executing functional workloads in …

Fastlane: Test minimization for rapidly deployed large-scale online services

AA Philip, R Bhagwan, R Kumar… - 2019 IEEE/ACM 41st …, 2019 - ieeexplore.ieee.org
Today, we depend on numerous large-scale services for basic operations such as email.
These services, built on the basis of Continuous Integration/Continuous Deployment (CI/CD) …

Improving test effectiveness using test executions history: An industrial experience report

A Najafi, W Shang, PC Rigby - 2019 IEEE/ACM 41st …, 2019 - ieeexplore.ieee.org
The cost of software testing has become a burden for software companies in the era of rapid
release and continuous integration. Our industrial collaborator Ericsson also faces the …

An empirical study of common challenges in developing deep learning applications

T Zhang, C Gao, L Ma, M Lyu… - 2019 IEEE 30th …, 2019 - ieeexplore.ieee.org
Recent advances in deep learning promote the innovation of many intelligent systems and
applications such as autonomous driving and image recognition. Despite enormous efforts …

Evaluating test-suite reduction in real software evolution

A Shi, A Gyori, S Mahmood, P Zhao… - Proceedings of the 27th …, 2018 - dl.acm.org
Test-suite reduction (TSR) speeds up regression testing by removing redundant tests from
the test suite, thus running fewer tests in the future builds. To decide whether to use TSR or …

iDFlakies: A framework for detecting and partially classifying flaky tests

W Lam, R Oei, A Shi, D Marinov… - 2019 12th ieee …, 2019 - ieeexplore.ieee.org
Regression testing is increasingly important with the wide use of continuous integration. A
desirable requirement for regression testing is that a test failure reliably indicates a problem …

Understanding and facilitating the co-evolution of production and test code

S Wang, M Wen, Y Liu, Y Wang… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
Software products frequently evolve. When the production code undergoes major changes
such as feature addition or removal, the corresponding test code typically should co-evolve …