Evaluating capture and replay and model-based performance testing tools: an empirical comparison

EM Rodrigues, RS Saad, FM Oliveira… - Proceedings of the 8th …, 2014 - dl.acm.org
EM Rodrigues, RS Saad, FM Oliveira, LT Costa, M Bernardino, AF Zorzo
Proceedings of the 8th ACM/IEEE International Symposium on Empirical …, 2014dl.acm.org
[Context] A variety of testing tools have been developed to support and automate software
performance testing activities. These tools may use different techniques, such as Model-
Based Testing (MBT) or Capture and Replay (CR).[Goal] For software companies, it is
important to evaluate such tools wrt the effort required for creating test artifacts using them;
despite its importance, there are few empirical studies comparing performance testing tools,
specially tools developed with different approaches.[Method] We are conducting …
[Context] A variety of testing tools have been developed to support and automate software performance testing activities. These tools may use different techniques, such as Model-Based Testing (MBT) or Capture and Replay (CR). [Goal] For software companies, it is important to evaluate such tools w.r.t. the effort required for creating test artifacts using them; despite its importance, there are few empirical studies comparing performance testing tools, specially tools developed with different approaches. [Method] We are conducting experimental studies to provide evidence about the required effort to use CR-based tools and MBT tools. In this paper, we present our first results, evaluating the effort (time spent) when using LoadRunner and Visual Studio CR-based tools, and the PLeTsPerf MBT tool to create performance test scripts and scenarios to test Web applications, in the context of a collaboration project between Software Engineering Research Center at PUCRS and a technological laboratory of a global IT company. [Results] Our results indicate that, for simple testing tasks, the effort of using a CR-based tool was lower than using an MBT tool, but as the testing complexity increases tasks, the advantage of using MBT grows significantly. [Conclusions] To conclude, we discuss the lessons we learned from the design, operation, and analysis of our empirical experiment.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果