A test oracle determines whether a test execution reveals a fault, often by comparing the
observed program output to the expected output. This is not always practical, for example …

Automated program repair is the problem of automatically fixing bugs in programs in order to
significantly reduce the debugging costs and improve the software quality. To address this …

Web Application Programming Interfaces (APIs) specify how to access services and data
over the network, typically using Web services. Web APIs are rapidly proliferating as a key …

Modern information technology paradigms, such as online services and off-the-shelf
products, often involve a wide variety of users with different or even conflicting objectives …

Software testing depends on effective oracles. Implicit oracles, such as checks for program
crashes, are widely applicable but narrow in scope. Oracles based on formal specifications …

Metamorphic relations (MRs) describe the invariant relationships between program inputs
and outputs. By checking for violations of MRs, faults in programs can be detected …

Metamorphic testing involves reasoning on necessary properties that a program under test
should exhibit regarding multiple input and output variables. A general approach consists of …

Abstract Model transformations play a cornerstone role in Model-Driven Engineering (MDE)
as they provide the essential mechanisms for manipulating and transforming models …

When testing scientific software, it is often challenging or even impossible to craft a test
oracle for checking whether the program under test produces the expected output when …

This is the first work to report on inferential testing at scale in industry. Specifically, it reports
the experience of automated testing of integrity systems at Meta. We built an internal tool …