Non-deterministic tests and where to find them: Empirically investigating the relationship between flaky tests and test smells by examining test order dependency

S Lamprou - 2022 - diva-portal.org
Flaky tests are non-deterministic tests that both pass and fail when no new code changes
have been introduced to the code under test. This is a widespread problem for the …

[PDF][PDF] Verifying determinism in sequential programs (extended version)

R Mudduluru, J Waataja… - … of Washington, Tech …, 2021 - dada.cs.washington.edu
When a program is nondeterministic, it is difficult to test and debug. Nondeterminism occurs
even in sequential programs: for example, as a result of iterating over the elements of a hash …

Proactively detecting unreliable tests

A Gyori - 2017 - ideals.illinois.edu
Regression testing is the most wide-spread method to ensure the quality of software
systems. Whenever a change is made to the software, tests are run to ensure bugs are not …

Detecting, characterizing, and taming flaky tests

W Lam - 2021 - ideals.illinois.edu
As software evolves, developers typically perform regression testing to ensure that their
code changes do not break existing functionalities. During regression testing, developers …

Reducing Effort for Flaky Test Detection through Dynamic Program Analysis

A Tacke - 2022 - mediatum.ub.tum.de
Flaky tests, that yield varying outcomes for an invariant codebase, hinder regression testing.
If one is not aware that they behave non-deterministically, their outcome may incorrectly …

Flakiness Goes Live: Insights from Running Flaky Tests into the Field

M Barboni, A Bertolino, G De Angelis - Available at SSRN 4095579 - papers.ssrn.com
Test flakiness is a topmost concern in software test automation. While conducting pre-
deployment testing, those tests that are flagged as flaky are put aside for being either …

nCODET: A Tool For Novice Developer To Detect Untestable Code

SB Hisamudin - Turkish Journal of Computer and Mathematics …, 2021 - turcomat.org
Uncontrollability is troublesome for unit testing. It causes a non-deterministic behavior where
the same input can produce different results based on different executions. The non …

Automated fixing of wrong assumptions on underdetermined specifications

P Zhang - 2020 - ideals.illinois.edu
Software specifications assist in the implementation of software by stating expected software
behavior. Many software specifications are deterministic, ie, the software produces the same …

Tutorial T3B: Engineering Change Order (ECO) Phase Challenges and Methodologies for High Performance Design

S Rangarajan, P Chakrabarti, S Sahais… - … Conference on VLSI …, 2014 - ieeexplore.ieee.org
Summary form only given. Engineering Change Order or ECO phase is always challenging
for any family of chip design. High Performance Microprocessors are largest and most …

[PDF][PDF] ISTI Technical Reports

B Miranda - robertoverdecchia.github.io
Flaky tests plague regression testing in Continuous Integration environments by slowing
down change releases, wasting development effort, and also eroding testers trust in the test …