Tutorial

A tutorial presenting some background on temporal logic testers and the syntax used in CPSGrader.

Download PDF Tutorial

Using CPSGrader with a Custom Simulator

We propose currently two methods:

  1. File interface: The simplest method is to have the custom simulator write traces into files and grade them using the program CPSFileGrader.

  2. C++ API interface: CPSGrader main class is STLDriver, which exposes a simple API to run tests defined in a test plan. The easiest way to get started with the C++ API is to modify CPSFileGrader.cpp by replacing the call to the read_data function by a call to the simulator, or a wrapper function which will run a simulation and write the result in a simple vector of vector of double.

If these methods are not working for you, or if you encounter any issue, please Contact us and we will figure out a way to interface your simulator to CPSGrader.

Using CyberSim

CPSGrader comes with a robotic simulator based on NI LabView Robotics which was used in the MOOC EECS149.1x on edX. Instructions on how use CyberSim+CPSGrader are still available in the Virtual Lab section of the MOOC page: EECS 149.1x info page.

Customizing assignments and test plans used for grading the EECS149 labs is partially covered in the tutorial above.

Here is some information about using the NI Robotics Simulator:

Synthesis of Test Plans

Testers to be used with CPSGrader can also be automatically synthesized using labeled examples of student solutions/traces that exhibit certain desired behavior. Details of the technique are in our EMSOFT'14 paper. We also provide a small module to demonstrate how synthesis works. You will need to install the Breach MATLAB toolbox to run this module.

Download Synthesis Module (13 MB zip archive)