Experiments

Experiment environment:

CPU: Intel® Core™ i7-10750H CPU @ 2.60GHz × 6 

Memory: 10 GB

OS: Ubuntu 20.04.5 LTS, 64 bits

Tool: Uppaal Stratego version 4.1.20-stratego-11

Experiment artefacts:

• Three models: test-case-1.xml, test-case-5.xml, test-case-10.xml

• One external library for learning: libexternal_learning.so

• The folder "stratego" is empty. Please download the right version of Uppaal Stratego from: uppaal.org, and put the files in the folder "bin" into this folder.

• The folder "policies" is for storing the decision-making strategies that are synthesised by running the three models in Uppaal Stratego.

• The folder "NonlinearController" is the Java code for the system under test (SUT).

Run the experiments:

• Download AMOST2023.zip (link). 

• Put the folder "AMOST2023" in your home folder.

• Run "./exp.sh" in your terminal. This will run the entire experiment including learning and testing.

• (Optional) "SUT.jar" is executable alone. It will just run testing. "SUT.jar" is exported from the Java code of SUT. Run "java -jar SUT.jar" in the terminal.

Terminal message:

• The terminal will first show the results of learning and verification. 

• Then the terminal will show the number of errors found in the SUT. 

• The message of an error is printed in line 193, Car.java. When the tracking controller fails to converge to the reference trajectory within this limit of iterations, an error is recorded.