Embedded Files
Instructions to try with Evoobj and Evosuite:
Instructions to try with Evoobj and Evosuite:
We build Evoobj on top of Evosuite. We can download the tool here. We can set different options to enable/disable Evoobj functionalities. Here is a tutorial to run Evoobj on target methods.
Ensure JDK 8 is installed.
Download the scripts and the target method list here.
Extract the 2 shell scripts (based on DynaMOSA approach) and method list text file into the same directory as the other SF100 project folders.
The Evosuite jar file, 2 shell scripts, method list text file and the 100 project folders should be in the same directory as seen in the screenshot below.
4. Run the two scripts with command ./<script-name>, as shown in the screenshot below.
5. When Evosuite is done, there will be two folders containing the results in excel files for the two experiments, each named with <script-name>. In the folders there will be two excel files for each project tested, as shown below. One of the excel file contains the results for all 10 iterations of the experiment, while the excel file with suffix _10times merges all 10 results into one row and calculates average results of the 10 iterations.
An example of the test results file 27_gangup_evotest.xlsx
An example of the test results file 27_gangup_evotest_10times.xlsx
Example 1
Example 1
Target method :
Object construction graph derived by Evoobj from the target branch:
By visiting each node in the above object construction graph, we can generate test skeleton as:
BasicRules basicRules0 = new BasicRules();int int0 = 1780;int int1 = 29;byte byte0 = (byte)2;byte byte1 = (byte)19;Action action0 = new Action(int0, int1, byte0, byte1, byte0);Action action1 = new Action(byte0, byte1, int0);int int2 = action1.getTarget();int int3 = action1.getActor();long long0 = 0L;GameState gameState0 = new GameState(long0);GameState gameState1 = new GameState();Player[] playerArray0 = gameState1.players();String string0 = "GameState.addPlayer(): PlayerID '";String string1 = "6q5\"REsqp,G<n.16l#";int int4 = (-141);Player player0 = new Player(action1.ACTION_JOIN_AGREE, string0, string1, int4);playerArray0[1] = player0;gameState1.setGameState(action1.ACTION_JOIN);Player player1 = gameState1.player(int2);long long1 = 0L;boolean boolean0 = true;player1.setDead(long1, boolean0);Player player2 = gameState1.player(int3);long long2 = 0L;boolean boolean1 = true;player2.setDead(long2, boolean1);boolean boolean2 = basicRules0.checkRules(action1, gameState1);
Coverage comparison for covering branches in the target method with DynaMOSA within 100s budget:
Evosuite:
Final coverage: 0.038461538461538464
Initial Coverage: 0.01282051282051282
Initialization Time: 1.588s
Used generations: 778
Evoobj:
Final coverage: 0.5641025641025641
Initial Coverage: 0.3076923076923077
Initialization Time: 20.849s
Used generations: 488
Example 2
Example 2
Target method :
Object construction graph derived by Evoobj from the target branch:
By visiting each node in the above object construction graph, we can generate test skeleton as:
StmtSummAmt stmtSummAmt0 = new StmtSummAmt();String string0 = "const";stmtSummAmt0.setStmtSummType(string0);StmtSummAmt stmtSummAmt1 = new StmtSummAmt();stmtSummAmt1.setStmtSummType(string0);String string1 = "^351YT6_";boolean boolean0 = stmtSummAmt0.equals(stmtSummAmt1);
Coverage comparison for covering branches in the target method with DynaMOSA within 100s budget:
Evosuite:
Final coverage: 0.115384615384615
Initial Coverage: 0.115384615384615
Initialization Time: 1.066s
Used generations: 1438
Evoobj:
Final coverage: 0.730769230769231
Initial Coverage: 0.273076923076923
Initialization Time: 13.351s
Used generations: 1101
Example 3
Example 3
Target method :
Object construction graph derived by Evoobj from the target branch:
By visiting each node in the above object construction graph, we can generate test skeleton as:
ChksumInfo chksumInfo0 = new ChksumInfo();RefInfo refInfo0 = new RefInfo();chksumInfo0.setRefInfo(refInfo0);RefInfo refInfo1 = chksumInfo0.getRefInfo();String string0 = "Ut^Y!;1>^b<^D%/2c";refInfo1.setRefId(string0);String string1 = "";refInfo1.setRefType(string1);String string2 = "='";chksumInfo0.setMsgType(string2);ChksumInfo chksumInfo1 = new ChksumInfo();chksumInfo1.setRefInfo(refInfo0);RefInfo refInfo2 = chksumInfo1.getRefInfo();String string3 = "";refInfo2.setRefId(string3);refInfo2.setRefType(string2);String string4 = "51YT6_f";chksumInfo1.setMsgType(string4);Object object0 = new Object();boolean boolean0 = chksumInfo0.equals(chksumInfo1);
Coverage comparison for covering branches in the target method with DynaMOSA within 100s budget:
Evosuite:
Final coverage: 0.0970588235294118
Initial Coverage: 0.0882352941176471
Initialization Time: 1.415s
Used generations: 1333
Evoobj:
Final coverage: 0.547058823529412
Initial Coverage: 0.31764705882353
Initialization Time: 32.042s
Used generations: 428
Example 4
Example 4
Target method :
Object construction graph derived by Evoobj from the target branch:
By visiting each node in the above object construction graph, we can generate test skeleton as:
RecPmtRec recPmtRec0 = new RecPmtRec();PmtInfo_Type pmtInfo_Type0 = new PmtInfo_Type();recPmtRec0.setPmtInfo(pmtInfo_Type0);String string0 = "XiD'x{W";recPmtRec0.setRecPmtId(string0);RecPmtRec recPmtRec1 = new RecPmtRec();PmtInfo_Type pmtInfo_Type1 = new PmtInfo_Type();recPmtRec1.setPmtInfo(pmtInfo_Type1);String string1 = "";recPmtRec1.setRecPmtId(string1);String string2 = "";boolean boolean0 = recPmtRec0.equals(recPmtRec1);
Coverage comparison for covering branches in the target method with DynaMOSA within 100s budget:
Evosuite:
Final coverage: 0.0882352941176471
Initial Coverage: 0.0882352941176471
Initialization Time: 7.597s
Used generations: 72
Evoobj:
Final coverage: 0.620588235294118
Initial Coverage: 0.208823529411765
Initialization Time: 36.846s
Used generations: 56
Example 5
Example 5
Target method :
Object construction graph derived by Evoobj from the target branch:
By visiting each node in the above object construction graph, we can generate test skeleton as:
Binary binary0 = new Binary();long long0 = 1026L;binary0.setBinLength(long0);byte[] byteArray0 = new byte[4];byte byte0 = (byte)0;byteArray0[0] = byte0;byte byte1 = (byte) (-110);byteArray0[1] = byte1;byte byte2 = (byte)0;byteArray0[2] = byte2;byte byte3 = (byte)6;byteArray0[3] = byte3;binary0.setBinData(byteArray0);long long1 = (-385L);binary0.setBinLength(long1);long long2 = (-1L);binary0.setBinLength(long2);String string0 = "";binary0.setContentType(string0);Binary binary1 = new Binary();binary1.setBinLength(byteArray0[0]);binary1.setBinData(byteArray0);long long3 = 2919L;binary1.setBinLength(long3);long long4 = 0L;binary1.setBinLength(long4);String string1 = "const";binary1.setContentType(string1);String string2 = "^351YT6_";boolean boolean0 = binary0.equals(binary1);
Coverage comparison for covering branches in the target method with DynaMOSA within 100s budget:
Evosuite:
Final coverage: 0.126923076923077
Initial Coverage: 0.115384615384615
Initialization Time: 1.125s
Used generations: 1367
Evoobj:
Final coverage: 0.423076923076923
Initial Coverage: 0.269230769230769
Initialization Time: 16.441s
Used generations: 1003
Page updated
Google Sites
Report abuse