[HTML][HTML] Flakiness goes live: Insights from an In Vivo testing simulation study
Context: Test flakiness is a topmost concern in software test automation. While conducting
pre-deployment testing, those tests that are flagged as flaky are put aside for being either …
pre-deployment testing, those tests that are flagged as flaky are put aside for being either …
Runtime Verification of Crypto APIs: An Empirical Study
A Torres, P Costa, L Amaral, J Pastro… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
Misuse of cryptographic (crypto) APIs is a noteworthy cause of security vulnerabilities. For
this reason, static analyzers were recently proposed for detecting crypto API misuses. They …
this reason, static analyzers were recently proposed for detecting crypto API misuses. They …
Approximate transformations as mutation operators
Mutation testing is a well-established approach for evaluating test-suite quality by modifying
code using syntax-changing (and potentially semantics-changing) transformations, called …
code using syntax-changing (and potentially semantics-changing) transformations, called …
Practical automatic lightweight nondeterminism and flaky test detection and debugging for Python
A Groce, J Holmes - 2020 IEEE 20th International Conference …, 2020 - ieeexplore.ieee.org
A critically important, but surprisingly neglected, aspect of system reliability is system
predictability. Many soft-ware systems are implemented using mechanisms (unsafe …
predictability. Many soft-ware systems are implemented using mechanisms (unsafe …
WEFix: Intelligent Automatic Generation of Explicit Waits for Efficient Web End-to-End Flaky Tests
Web end-to-end (e2e) testing evaluates the workflow of a web application. It simulates real-
world user scenarios to ensure the application flows behave as expected. However, web …
world user scenarios to ensure the application flows behave as expected. However, web …
A method of test case set generation in the commutativity test of reduce functions
X Mu, L Liu, P Zhang, J Li, H Li - Science of Computer Programming, 2024 - Elsevier
MapReduce framework has become one of the more popular big data processing
frameworks. In the MapReduce framework, the test of the commutativity problem of the …
frameworks. In the MapReduce framework, the test of the commutativity problem of the …
[PDF][PDF] Automatically reproducing timing-dependent flaky-test failures
When developers run tests after making code changes, they may encounter test failures from
flaky tests, which are tests that can non-deterministically pass or fail on the same version of …
flaky tests, which are tests that can non-deterministically pass or fail on the same version of …
A survey of Detecting Flakiness in Automated Test Regression Suite
Recently, Flaky Tests have gotten the attention of the research community. These tests not
only waste time and resources, but also undermine the reliability of the automated tests and …
only waste time and resources, but also undermine the reliability of the automated tests and …
Verifying determinism in sequential programs
R Mudduluru, J Waataja, S Millstein… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
When a program is nondeterministic, it is difficult to test and debug. Nondeterminism occurs
even in sequential programs: eg, by iterating over the elements of a hash table. We have …
even in sequential programs: eg, by iterating over the elements of a hash table. We have …
RHLE: Modular Deductive Verification of Relational Properties
Hoare-style program logics are a popular and effective technique for software verification.
Relational program logics are an instance of this approach that enables reasoning about …
Relational program logics are an instance of this approach that enables reasoning about …