On the reliability of coverage-based fuzzer benchmarking
Given a program where none of our fuzzers finds any bugs, how do we know which fuzzer is
better? In practice, we often look to code coverage as a proxy measure of fuzzer …
better? In practice, we often look to code coverage as a proxy measure of fuzzer …
Chatgpt vs sbst: A comparative assessment of unit test suite generation
Recent advancements in large language models (LLMs) have demonstrated exceptional
success in a wide range of general domain tasks, such as question answering and following …
success in a wide range of general domain tasks, such as question answering and following …
On the reproducibility of software defect datasets
HN Zhu, C Rubio-González - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Software defect datasets are crucial to facilitating the evaluation and comparison of
techniques in fields such as fault localization, test generation, and automated program …
techniques in fields such as fault localization, test generation, and automated program …
A large scale empirical comparison of state-of-the-art search-based test case generators
Context Replication studies and experiments form an important foundation in advancing
scientific research. While their prevalence in Software Engineering is increasing, there is still …
scientific research. While their prevalence in Software Engineering is increasing, there is still …
Learning to predict test effectiveness
M Zakeri‐Nasrabadi, S Parsa - International Journal of …, 2022 - Wiley Online Library
The high cost of the test can be dramatically reduced, provided that the coverability as an
inherent feature of the code under test is predictable. This article offers a machine learning …
inherent feature of the code under test is predictable. This article offers a machine learning …
Choosing the fitness function for the job: Automated generation of test suites that detect real faults
Search‐based unit test generation, if effective at fault detection, can lower the cost of testing.
Such techniques rely on fitness functions to guide the search. Ultimately, such functions …
Such techniques rely on fitness functions to guide the search. Ultimately, such functions …
Defect prediction guided search-based software testing
Today, most automated test generators, such as search-based software testing (SBST)
techniques focus on achieving high code coverage. However, high code coverage is not …
techniques focus on achieving high code coverage. However, high code coverage is not …
Effective and efficient API misuse detection via exception propagation and search-based testing
Application Programming Interfaces (APIs) typically come with (implicit) usage constraints.
The violations of these constraints (API misuses) can lead to software crashes. Even though …
The violations of these constraints (API misuses) can lead to software crashes. Even though …
Testability-Driven Development: An Improvement to the TDD Efficiency
S Parsa, M Zakeri-Nasrabadi, B Turhan - Computer Standards & Interfaces, 2024 - Elsevier
Test-first development (TFD) is a software development approach involving automated tests
before writing the actual code. TFD offers many benefits, such as improving code quality …
before writing the actual code. TFD offers many benefits, such as improving code quality …
[HTML][HTML] Test flakiness' causes, detection, impact and responses: A multivocal review
Flaky tests (tests with non-deterministic outcomes) pose a major challenge for software
testing. They are known to cause significant issues, such as reducing the effectiveness and …
testing. They are known to cause significant issues, such as reducing the effectiveness and …