Demo 3 - MPU Target and Target structure

Fill the form

Go to http://157.26.64.222/benchmark.

Fil the form with the following information :

• Target : Jetson Orin Nano
• Runtime : TensorRT
• Model : big_model.onnx

Click on the Launch the benchmark button.

Key talking points :

• Target : The target is a Jetson Orin Nano, a powerful device with a GPU.
• Runtime : The runtime is TensorRT, a runtime optimized for NVIDIA GPUs.
• Model : The model is a big model, for embedded standards. It will take more time to run.

Wait for the results & show the pipeline

The result should be available in about 3 minutes.

Go to the targets repository page and show the different repository. Select and show the JetsonOrinNano_TRT.

Here is an MCU repository for the LPC55S69_TFLite.

Key talking points :

• Structure : The structure of the target repository is important. It contains all the scripts and files needed to run the benchmark.
  • AI_Support : Prepare the environment and generate the appropriate code for the target if needed.
  • AI_Build : Build the target code.
  • AI_Deploy : Deploy the model and the target code to the target.
  • AI_Mmanager : Run the benchmark and measure the performance.
  • AI_Project : Contains the target project and code base.

Analyze the results

Key talking points :

• Model : Big model, the result visualization is more complex and will be improved in the future.

In case of problems :

• Here is the resulting JSON.
• Here is the pipeline of the same benchmark.