A survey of flaky tests

O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

Testing web enabled simulation at scale using metamorphic testing

J Ahlgren, M Berezin, K Bojarczuk… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
We report on Facebook's deployment of MIA (Metamorphic Interaction Automaton). MIA is
used to test Facebook's Web Enabled Simulation, built on a web infrastructure of hundreds …

Ci/cd pipelines evolution and restructuring: A qualitative and quantitative study

F Zampetti, S Geremia, G Bavota… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
Continuous Integration and Delivery (CI/CD) pipelines entail the build process automation
on dedicated machines, and have been demonstrated to produce several advantages …

What helped, and what did not? An evaluation of the strategies to improve continuous integration

X Jin, F Servant - … IEEE/ACM 43rd International Conference on …, 2021 - ieeexplore.ieee.org
Continuous integration (CI) is a widely used practice in modern software engineering.
Unfortunately, it is also an expensive practice-Google and Mozilla estimate their CI systems …

On the impact of continuous integration on refactoring practice: An exploratory study on travistorrent

I Saidani, A Ouni, MW Mkaouer, F Palomba - Information and Software …, 2021 - Elsevier
Context: The ultimate goal of Continuous Integration (CI) is to support developers in
integrating changes into production constantly and quickly through automated build process …

Are you still working on this? An empirical study on pull request abandonment

Z Li, Y Yu, T Wang, G Yin, S Li… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
The great success of numerous community-based open source software (OSS) is based on
volunteers continuously submitting contributions, but ensuring sustainability is a persistent …

Learning from reproducing computational results: introducing three principles and the Reproduction Package

MS Krafczyk, A Shi, A Bhaskar… - … Transactions of the …, 2021 - royalsocietypublishing.org
We carry out efforts to reproduce computational results for seven published articles and
identify barriers to computational reproducibility. We then derive three principles to guide the …

Bf-detector: an automated tool for ci build failure detection

I Saidani, A Ouni, M Chouchen… - Proceedings of the 29th …, 2021 - dl.acm.org
Continuous Integration (CI) aims at supporting developers in inte-grating code changes
quickly through automated building. How-ever, there is a consensus that CI build failure is a …

Developers are neither enemies nor users: they are collaborators

PD Chowdhury, J Hallett, N Patnaik… - 2021 IEEE Secure …, 2021 - ieeexplore.ieee.org
Developers struggle to program securely. Prior works have reviewed the methods used to
run user-studies with developers, systematized the ancestry of security API usability …

A survey of DevOps in the South African software context

M Rowse, J Cohen - 2021 - scholarspace.manoa.hawaii.edu
This study investigated DevOps practices and experiences in the South African software
development context, along with associated perceptions of benefits and challenges. Survey …