Table 2 Mutation analysis results
Modules | Experiment | Percentage of mutants killed—mutation score % | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Equivalent classes | Boundary value analysis | Logical | |||||||||||
Name | Op. | Mutants | EC | PW | AC | EC | PW | AC | PC | CC | ACC | CoC | |
ATM | 3 | 11 | Original | 81.8 | 81.8 | 81.8 | 81.8 | 81.8 | 81.8 | – | – | – | – |
Improved | 81.8 | 81.8 | 81.8 | 81.8 | 81.8 | 81.8 | 81.8 | 81.8 | 81.8 | 81.8 | |||
Randomization | 92.7 | 90.9 | 87.3 | 92.7 | 90.9 | 87.3 | 94.5 | 90.9 | 96.4 | 90.9 | |||
Sort | 1 | 123 | Original | 89.4 | 89.4 | 89.4 | 89.4 | 89.4 | 89.4 | – | – | – | – |
Improved | 89.4 | 89.4 | 89.4 | 89.4 | 89.4 | 89.4 | 91.1 | 91.1 | 91.1 | 91.1 | |||
Randomization | 90.7 | 90.7 | 91.1 | 90.7 | 90.7 | 91.1 | 91.1 | 91.1 | 91.1 | 91.1 | |||
Calculator | 6 | 120 | Original | 47.5 | 47.5 | 47.5 | 74.2 | 74.2 | 74.2 | – | – | – | – |
Improved | 46.5 | 46.6 | 46.6 | 71.6 | 71.6 | 71.6 | 46.6 | 46.6 | 46.6 | 46.6 | |||
Randomization | 58.7 | 50.8 | 56.8 | 78 | 75 | 76.2 | 55.3 | 59.5 | 56 | 51.8 | |||
Calendar | 1 | 67 | Original | 9 | 19.4 | 19.4 | 25.4 | 35.8 | 35.8 | – | – | – | – |
Improved | 80.6 | 94 | 94 | 0 | 35.8 | 35.8 | 94 | 94 | 94 | 94 | |||
Randomization | 80.6 | 94 | 94 | 0 | 35.8 | 35.8 | 94 | 94 | 94 | 94 | |||
Counter | 4 | 87 | Original | 41.4 | 85.1 | 85.1 | 41.4 | 94.2 | 94.2 | – | – | – | – |
Improved | 41.4 | 85.1 | 85.1 | 41.4 | 94.2 | 94.2 | 85.1 | 85.1 | 85.1 | 85.1 | |||
Randomization | 45.5 | 86.8 | 87.1 | 43.2 | 95.2 | 97.5 | 71.9 | 80.7 | 75.4 | 78.4 | |||
Division | 1 | 29 | Original | 31 | 31 | 31 | – | – | – | – | – | – | – |
Improved | 31 | 31 | 31 | 89.6 | 96.5 | 96.5 | 34.5 | 34.5 | 34.5 | 34.5 | |||
Randomization | 59.3 | 73.8 | 68.3 | 89.6 | 96.5 | 96.5 | 53.8 | 54.5 | 43.4 | 74.5 | |||
Fifo | 2 | 40 | Original | 90 | 90 | 90 | 90 | 90 | 90 | – | – | – | – |
Improved | 90 | 90 | 90 | 90 | 90 | 90 | 90 | 90 | 90 | 90 | |||
Randomization | 90 | 90 | 90 | 90 | 90 | 90 | 90 | 90 | 90 | 90 | |||
Prime | 1 | 66 | Original | 34.8 | 34.8 | 53 | – | – | – | – | – | – | – |
Improved | 34.8 | 34.8 | 53 | 0 | 43.9 | 43.9 | 62.1 | 62.1 | 62.1 | 62.1 | |||
Randomization | 39.1 | 40.6 | 75.4 | 0 | 43.9 | 43.9 | 71.5 | 71.5 | 72.4 | 78.5 | |||
Swap | 3 | 8 | Original | 100 | 100 | 100 | 100 | 100 | 100 | – | – | – | – |
Improved | 100 | 100 | 100 | 100 | 100 | 100 | 37.5 | 37.5 | 37.5 | 37.5 | |||
Randomization | 90 | 85 | 87.5 | 90 | 85 | 87.5 | 97.5 | 80 | 87.5 | 95 | |||
Team | 2 | 89 | Original | 68.5 | 68.5 | 68.5 | 68.5 | 68.5 | 68.5 | – | – | – | – |
Improved | 68.5 | 68.5 | 68.5 | 68.5 | 68.5 | 68.5 | 68.5 | 68.5 | 68.5 | 68.5 | |||
Randomization | 68.8 | 69 | 69 | 68.8 | 69 | 69 | 67.9 | 73.3 | 82.7 | 80.2 | |||
TicTacToe | 3 | 764 | Original | 0 | 21.9 | 40.3 | 0 | 20.4 | 40.3 | – | – | – | – |
Improved | 0 | 21.9 | 40.3 | 0 | 20.4 | 40.3 | 3.1 | 23.3 | 36.8 | 40 | |||
Randomization | 0 | 20.5 | 40.5 | 0 | 18.1 | 41.3 | 3.1 | 23.4 | 36.3 | 40.9 | |||
Wd | 3 | 68 | Original | 91.2 | 91.2 | 91.2 | 91.2 | 91.2 | 91.2 | – | – | – | – |
Improved | 91.2 | 91.2 | 91.2 | 91.2 | 91.2 | 91.2 | 91.2 | 91.2 | 91.2 | 91.2 | |||
Randomization | 90 | 88.8 | 86.5 | 90 | 88.8 | 86.8 | 86.5 | 87.6 | 88.8 | 86.5 | |||
Average | 30 | 1472 | Original | 61.9 | 69.5 | 71.3 | 66.2 | 74.5 | 76.5 | – | – | – | – |
Improved | 63 | 69.5 | 72.6 | 60.3 | 73.6 | 75.3 | 65.5 | 67.1 | 68.3 | 68.5 | |||
Randomization | 67.1 | 72.6 | 77.8 | 61.1 | 72.5 | 75.2 | 73.1 | 74.7 | 76.2 | 79.1 | |||