Rankings

Explore benchmarks

Filter by model, hardware, workload and quantization. Every score links to the comparisons and experiments behind it.

Clear filters

Top Engines

Not enough eligible results to rank.

Coverage

Speed score per device, out of 100: each device ranked on its own.
DesktopMobile
M5 Max 64 GiB macOS 27 Apple M5 MaxOnePlus 13 16 GB Android 16 Qualcomm Snapdragon 8 Elite (SM8750)Pixel 8 8 GB Android 16 Google Tensor G3iPhone 12 4 GB iOS 27 Apple A14 Bionic
llama.cpp90 out of 100, in 8 of 8 comparisonsNo rival yet No other engine has a result in the same comparison yet.No rival yet No other engine has a result in the same comparison yet.No rival yet No other engine has a result in the same comparison yet.
Magnitude97 out of 100, in 4 of 8 comparisonsNot measured on this device.Not measured on this device.Not measured on this device.
MLX LM100 out of 100, in 6 of 8 comparisonsNot measured on this device.Not measured on this device.Not measured on this device.
Ollama95 out of 100, in 6 of 8 comparisonsNot measured on this device.Not measured on this device.Not measured on this device.
Rapid-MLX99 out of 100, in 4 of 8 comparisonsNot measured on this device.Not measured on this device.Not measured on this device.
ZML72 out of 100, in 4 of 8 comparisonsNot measured on this device.Not measured on this device.Not measured on this device.

Speed

Speed, LFM2.5 1.2B Instruct on iPhone 12 · 4 GB, bf16 · Archive 256 input / 128 output · iOS 27
RankEngineDecode and TTFT
Not rankedllama.cpp ggml-orgUnsupported
details

LFM2.5 1.2B Instruct on iPhone 12 · 4 GB · bf16 · Archive 256 input / 128 output · iOS 27

Medians with the model warmed; model loading is excluded. Each table uses one matched comparison.

llama.cpp: llama.cpp errored on the opposite check in qualification: The app wrote no result for run (exit 1); iOS ends an app that exceeds its memory limit or leaves the foreground.

Memory usage by engine

Memory usage by engine, LFM2.5 1.2B Instruct on iPhone 12 · 4 GB, bf16 · Archive 256 input / 128 output · iOS 27
RankEngineMemory
Not rankedllama.cpp ggml-orgUnsupported
details

LFM2.5 1.2B Instruct on iPhone 12 · 4 GB · bf16 · Archive 256 input / 128 output · iOS 27

Memory ranks require comparable, calibrated measurements. Unavailable measurements remain unranked.

llama.cpp: llama.cpp errored on the opposite check in qualification: The app wrote no result for run (exit 1); iOS ends an app that exceeds its memory limit or leaves the foreground.

Every comparison

Comparisons in this view: each engine's score in each comparison, out of 100, or why it has none.
Comparisonllama.cpp
LFM2.5 1.2B Instruct on iPhone 12 · 4 GB bf16 · Archive 2048 input / 128 output · iOS 27 Not counted: fewer than two scored enginesUnsupported
LFM2.5 1.2B Instruct on iPhone 12 · 4 GB bf16 · Archive 256 input / 128 output · iOS 27 Not counted: fewer than two scored enginesUnsupported
LFM2.5 350M on iPhone 12 · 4 GB bf16 · Archive 2048 input / 128 output · iOS 27 Not counted: fewer than two scored enginesMeasured
LFM2.5 350M on iPhone 12 · 4 GB bf16 · Archive 256 input / 128 output · iOS 27 Not counted: fewer than two scored enginesMeasured
LFM2.5 1.2B Instruct on OnePlus 13 · 16 GB bf16 · Archive 2048 input / 128 output · Android 16 Not counted: fewer than two scored enginesFailed
LFM2.5 1.2B Instruct on OnePlus 13 · 16 GB bf16 · Archive 256 input / 128 output · Android 16 Not counted: fewer than two scored enginesMeasured
LFM2.5 350M on OnePlus 13 · 16 GB bf16 · Archive 2048 input / 128 output · Android 16 Not counted: fewer than two scored enginesMeasured
LFM2.5 350M on OnePlus 13 · 16 GB bf16 · Archive 256 input / 128 output · Android 16 Not counted: fewer than two scored enginesMeasured
LFM2.5 1.2B Instruct on Pixel 8 · 8 GB bf16 · Archive 2048 input / 128 output · Android 16 Not counted: fewer than two scored enginesFailed
LFM2.5 1.2B Instruct on Pixel 8 · 8 GB bf16 · Archive 256 input / 128 output · Android 16 Not counted: fewer than two scored enginesFailed
LFM2.5 350M on Pixel 8 · 8 GB bf16 · Archive 2048 input / 128 output · Android 16 Not counted: fewer than two scored enginesFailed
LFM2.5 350M on Pixel 8 · 8 GB bf16 · Archive 256 input / 128 output · Android 16 Not counted: fewer than two scored enginesMeasured

Each engine’s Speed score in each matched comparison, out of 100, or why it has none. How rankings work