Appendix A - Distribution of the obtained results

A boxplot is provided with the distribution of the results obtained by the different algorithms for each of the case studies grouped in the following three quality indicators:

• Hypervolume quality indicator (HV)
• Average Weighted Sum of Mutation Score and Normalized Test Execution Time (W MS TET)
• Maximun Mutation Score (Max MS)

Appendix B - Results for statistical tests

Detailled results data tables provided:

• Table B.6

RQ1 and RQ4: Vargha and Delaney values, comparison between NSGA-II combination with RS, NSGA-III and MOEA/D for the used metrics HV and W MS TET

• Table B.7

RQ2: Vargha and Delaney ˆA12 values between different objective combinations within NSGA-II and HV with white-box metrics.

• Table B.8

RQ3: Vargha and Delaney ˆA12 values between different objective combinations within NSGA-II and HV. Bold values refer to statistical significance (p-value < 0.05).

• Table B.9

RQ2: Vargha and Delaney ˆA12 values between different objective combinations within NSGA-II and W MS TET with white-box metrics.

• Table B.10

RQ3: Vargha and Delaney ˆA12 values between different objective combinations within NSGA-II and W MS TET. Bold values refer to statistical significance (p-value < 0.05).