Test automation can result in reduction in cost and human effort . If the optimal policy, the course of actions taken, for the intended objective in a testing process could be learnt by the testing system (e.g., a smart tester agent), then it could be reused in similar situations, thus leading to higher efficiency, i. e., less computational time. Automating stress testing to find performance breaking points remains a challenge for complex software systems. Common approaches are mainly based on source code or system model analysis or use-case based techniques. However, source code or system models might not  be available at testing time. In this paper, we propose a self-adaptive fuzzy reinforcement learning-based performance (stress) testing framework (SaFReL) that enables the tester agent to learn the optimal policy for generating stress test cases leading to performance breaking point without access to performance model of the system under test. SaFReL learns the optimal policy  through an initial learning  , then reuses it during a transfer learning phase, while keeping the learning running in the long-term . Through multiple experiments on a simulated environment, we demonstrate that our approach generates the stress test cases for different programs efficiently and adaptively without access to  performance models.
Test automation brings the potential to reduce costs and human effort , but several aspects of software testing remain challenging to automate. One such example is automated performance testing to find performance breaking points . Current approaches to tackle automated generation of performance test cases mainly involve using source code or system model analysis or use-case based techniques. However, source code and system models might not always be available at testing time. On the other hand, if the optimal performance testing policy for the intended objective in a testing process instead could be learned by the testing system, then test automation without advanced performance models could be possible. Furthermore, the learned policy could later be reused for similar software systems under test, thus leading to higher test efficiency. We propose SaFReL, a self-adaptive fuzzy reinforcement learning-based performance testing framework. SaFReL learns the optimal policy to generate performance test cases through an initial learning phase , then reuses it during a transfer learning phase, while keeping the learning running and updating the policy in the long term . Through multiple experiments on a simulated environment, we demonstrate that our approach generates the target performance test cases for different programs more efficiently than a typical testing process, and performs adaptively without access to source code and performance models.
R
can result in reduction in cost
brings the potential to reduce costs
R
. If the optimal policy, the course of actions taken, for the intended objective in a testing process could be learnt by the testing system (e.g., a smart tester agent), then it could be reused in similar situations, thus leading to higher efficiency, i. e., less computational time. Automating stress
, but several aspects of software testing remain challenging to automate. One such example is automated performance
R
remains a challenge for complex software systems. Common approaches are mainly based on
. Current approaches to tackle automated generation of performance test cases mainly involve using
R
or
and
A
always
R
In this paper, we propose a
On the other hand, if the optimal performance testing policy for the intended objective in a testing process instead could be learned by the testing system, then test automation without advanced performance models could be possible. Furthermore, the learned policy could later be reused for similar software systems under test, thus leading to higher test efficiency. We propose SaFReL, a
R
performance (stress) testing framework (SaFReL) that enables the tester agent to learn the optimal policy for generating stress test cases leading to performance breaking point without access to performance model of the system under test. SaFReL
performance testing framework. SaFReL
A
to generate performance test cases
A
phase
R
in the long-term
and updating the policy in the long term
R
stress
target performance
R
efficiently and
more efficiently than a typical testing process, and performs
A
source code and