ONNX Runtime Plugin for Unity

Pre-built ONNX Runtime libraries for Unity.

See Examples

https://github.com/asus4/onnxruntime-unity-examples

Yolox-Nano

https://github.com/asus4/onnxruntime-unity-examples/assets/357497/96ed9913-41b7-401d-a634-f0e2de4fc3c7

NanoSAM

https://github.com/asus4/onnxruntime-unity-examples/assets/357497/5e2b8712-87cc-4a3a-82b7-f217087a0ed1

Yolo11 Seg

https://github.com/user-attachments/assets/93c3dccd-569c-4a93-826b-0c9b5b60ebe9

Tested environment

• Unity: 6000.0.43f1 (LTS)
• ONNX Runtime: 1.22.1
• ONNX Runtime Extensions: 0.14.0
• ONNX Runtime GenAI: 0.8.3

Execution Providers & Extensions

Execution Providers

Execution Providers are hardware acceleration libraries for each platform. See official docs for more details.

| Platform | CPU | CoreML | NNAPI | CUDA | TensorRT | DirectML | XNNPACK | | --- | --- | --- | --- | --- | --- | --- | --- | | macOS | :white_check_mark: | :white_check_mark: | | | | | | | iOS | :white_check_mark: | :white_check_mark: | | | | | :construction: | | Android | :white_check_mark: | | :white_check_mark: | | | | :construction: | | Windows | :white_check_mark: | | | :construction: | :construction: | :white_check_mark: | | | Linux | :white_check_mark: | | | :construction: | :construction: | | |

ONNX Runtime Extensions

ONNX Runtime Extensions are a set of pre/post-processing.

| Platform | Extensions | | --- | --- | | macOS | :construction: | | iOS | :construction: | | Android | :construction: | | Windows | :construction: | | Linux | :construction: |

:white_check_mark: : Supported in Unity Core library
:construction: : Experimental Preview

How to Install

Pre-built libraries are available on NPM. Add the following scopedRegistries and dependencies in Packages/manifest.json.

  "scopedRegistries": [
    {
      "name": "NPM",
      "url": "https://registry.npmjs.com",
      "scopes": [
        "com.github.asus4"
      ]
    }
  ]
  "dependencies": {
    "com.github.asus4.onnxruntime": "0.4.2",
    "com.github.asus4.onnxruntime.unity": "0.4.2",
    "com.github.asus4.onnxruntime.win-x64-gpu": "0.4.2",
    "com.github.asus4.onnxruntime-extensions": "0.4.2",
    ... other dependencies
  }

What is included in each package

• com.github.asus4.onnxruntime : Core library
  • CPU provider for all platforms
  • GPU provider for iOS, Android, macOS and Windows(only DirectML)
• com.github.asus4.onnxruntime.unity : (Optional) Utilities for Unity
• com.github.asus4.onnxruntime.win-x64-gpu : (Optional) GPU provider for Windows
• com.github.asus4.onnxruntime.linux-x64-gpu : (Optional) GPU provider for Linux
• com.github.asus4.onnxruntime-extensions : (Optional) ONNX Runtime Extensions