What can I run on this hardware?
Measured inference runs per compute target. Every number states its runtime, precision and camera count. Edge targets are listed first.
Edge
| Target | Memory | Measured policies | Fails (measured) | Exceeds memory (inferred) |
|---|---|---|---|---|
| NVIDIA Jetson AGX Orin 64GB | 64 GB unified | 1 | — | — |
| NVIDIA Jetson AGX Thor 128GB | 128 GB unified | 2 | — | — |
| NVIDIA Jetson Orin Nano 8GB (Super) | 8 GB unified | 5 | — | 2 |
| NVIDIA Jetson Orin NX 16GB | 16 GB unified | — | — | 1 |
Apple Silicon
| Target | Memory | Measured policies | Fails (measured) | Exceeds memory (inferred) |
|---|---|---|---|---|
| Apple Silicon 16 GB | 16 GB unified | — | — | 1 |
| Apple Silicon 32 GB | 32 GB unified | — | — | — |
| Apple Silicon 64 GB | 64 GB unified | — | — | — |
Consumer GPU
| Target | Memory | Measured policies | Fails (measured) | Exceeds memory (inferred) |
|---|---|---|---|---|
| NVIDIA GeForce RTX 3060 12GB | 12 GB | — | — | 3 |
| NVIDIA GeForce RTX 4090 | 24 GB | 1 | — | — |
| NVIDIA GeForce RTX 5090 | 32 GB | — | — | — |
Datacenter
| Target | Memory | Measured policies | Fails (measured) | Exceeds memory (inferred) |
|---|---|---|---|---|
| NVIDIA A100 40GB | 40 GB | — | — | — |
| NVIDIA A100 80GB | 80 GB | — | — | — |
| NVIDIA H100 80GB | 80 GB | 2 | — | — |
| NVIDIA H200 | 141 GB | — | — | — |
| NVIDIA L4 | 24 GB | — | — | — |
| NVIDIA L40 | 48 GB | 1 | — | — |
| NVIDIA L40S | 48 GB | — | — | — |
| NVIDIA RTX PRO 6000 Blackwell Server | 96 GB | 1 | — | — |
| NVIDIA T4 | 16 GB | — | — | 1 |
Cloud
| Target | Memory | Measured policies | Fails (measured) | Exceeds memory (inferred) |
|---|---|---|---|---|
| NVIDIA A10G (AWS) | 24 GB | — | — | — |
CPU only
| Target | Memory | Measured policies | Fails (measured) | Exceeds memory (inferred) |
|---|---|---|---|---|
| CPU only (no accelerator) | system RAM | — | — | — |