Demo 1 - User Case

Open Navigator

Open the navigator in prive browsing and go to http://157.26.64.222/benchmark.

Key talking points :

• First Page : The first page is the VirtualLab’s home page. Explains what we are about to do.
• http : The VirtualLab doesn’t use yet https. It will come soon.

Fill the form

Fil the form with the following information :

• Target : Raspberry Pi 5
• Runtime : ONNX Runtime
• Model : small_model.onnx

Click on the Launch the benchmark button.

Key talking points :

• Target : The target is the device on which the benchmark will be run.
• Runtime : The runtime is the framework used to run the benchmark. Here ONNX Runtime is used, but other runtimes are available.
• Model : The model is the file that contains the model to be benchmarked. There a small model is used to get a quick result.

Wait for the results

The result should be available in about 20 seconds.

Key talking points :

• Events :
  • Start : The VirtualLab looks for an available runner that has the Target attached to. It then sends the model to the runner with other parameters.
  • Benchmark : The runner runs all the scripts and perform the benchmark.
  • End : The results are sent back to the VirtualLab and displayed to the user.

Analyze the results

Key talking points :

• General result : Display the general result of the benchmark.
• Layer by layer result : Display the latency result of each layer of the model.
• Visualization : The result can be visualized in different graphs.
• Improvement : The VirtualLab is still in development, the result page is planned to be greatly improved.

In case of problems :

• Here is the resulting JSON.
• Here is the pipeline of the same benchmark.

History

Go to the history page and show the previous results and the possibility to download them.

Key talking points :

• History : The history page contains all the previous results of the user.
• Download : The user can download the result in JSON format.
• Delete : The user can delete the result from the history.
• Re-upload : The user can re-upload the result to see it again.
• Compare : The user can compare the result with other results. We will see that in the next demo.