Results

Ranked results only: comparable, plausible and published runs. Unstable runs are included and flagged.

Score 3.2 4 ranked results Why one score version at a time?

More views: FamiliesEngines Compare two chips

  • CPU
  • GPU
  1. MLX GPU · Best chip: Apple M5 Max
    38.4
  2. Core ML CPU · Best chip: Apple M5 Max
    31.0
  3. DirectML GPU · Best chip: NVIDIA GeForce RTX 3070 Ti
    16.2
  4. ONNX Runtime CPU CPU · Best chip: NVIDIA GeForce RTX 3070 Ti
    2.52
Engines by their best chip’s median peak (score 3.2).
Engine Processor Best chip Median peak Chips Runs
MLX GPU Apple M5 Max 38.4 1 2
Core ML CPU Apple M5 Max 31.0 1 6
DirectML GPU NVIDIA GeForce RTX 3070 Ti 16.2 2 3
ONNX Runtime CPU CPU NVIDIA GeForce RTX 3070 Ti 2.52 2 2

The score is the most TOPS the device’s best engine produced, any precision that passes the math check, labelled with the engine and number format. The large-batch peak and the box total sit beside the score, never in it, so they don’t count here. Score versions are separate series: figures compare only within one version.