Rankings

Explore benchmarks

Filter by model, hardware, workload and quantization. Every score links to the comparisons and experiments behind it.

Clear filters

Top Engines

Not enough eligible results to rank.

Speed

Speed, LFM2.5 2.6B on iPhone 12 · 4 GB, 4-bit · Archive 256 input / 128 output · iOS 27
RankEngineDecode and TTFT
Not rankedllama.cpp ggml-orgNot counted
Not rankeduzu MiraiUnsupported
details

LFM2.5 2.6B on iPhone 12 · 4 GB · 4-bit · Archive 256 input / 128 output · iOS 27

Medians with the model warmed; model loading is excluded. Each table uses one matched comparison.

llama.cpp: Its output check failed: 7/9 of the checks the model passes at BF16; needs 8 and the mandatory ones (needle-start, continuation-128). Left out, failed by every BF16 configuration: color, sort, needle-end.

uzu: uzu can't run the frozen prompts: Error: uzu counted 23 input tokens, not the frozen prompt's 26 (measured in qualification).

Memory usage by engine

Memory usage by engine, LFM2.5 2.6B on iPhone 12 · 4 GB, 4-bit · Archive 256 input / 128 output · iOS 27
RankEngineMemory
Not rankedllama.cpp ggml-orgNot counted
Not rankeduzu MiraiUnsupported
details

LFM2.5 2.6B on iPhone 12 · 4 GB · 4-bit · Archive 256 input / 128 output · iOS 27

Memory ranks require comparable, calibrated measurements. Unavailable measurements remain unranked.

llama.cpp: Its output check failed: 7/9 of the checks the model passes at BF16; needs 8 and the mandatory ones (needle-start, continuation-128). Left out, failed by every BF16 configuration: color, sort, needle-end.

uzu: uzu can't run the frozen prompts: Error: uzu counted 23 input tokens, not the frozen prompt's 26 (measured in qualification).

Every comparison

Comparisons in this view: each engine's score in each comparison, out of 100, or why it has none.
ComparisonLiteRT-LMllama.cppuzu
LFM2.5 2.6B on iPhone 12 · 4 GB 4-bit · Archive 2048 input / 128 output · iOS 27 Not counted: fewer than two scored enginesNot runNot countedUnsupported
LFM2.5 2.6B on iPhone 12 · 4 GB 4-bit · Archive 256 input / 128 output · iOS 27 Not counted: fewer than two scored enginesNot runNot countedUnsupported
LFM2.5 2.6B on OnePlus 13 · 16 GB 4-bit · Archive 2048 input / 128 output · Android 16 Not counted: fewer than two scored enginesMeasured, approximateNot countedNot run
LFM2.5 2.6B on OnePlus 13 · 16 GB 4-bit · Archive 256 input / 128 output · Android 16 Not counted: fewer than two scored enginesMeasured, approximateNot countedNot run
LFM2.5 2.6B on Pixel 8 · 8 GB 4-bit · Archive 2048 input / 128 output · Android 16 Not counted: fewer than two scored enginesNot countedFailedNot run
LFM2.5 2.6B on Pixel 8 · 8 GB 4-bit · Archive 256 input / 128 output · Android 16 Not counted: fewer than two scored enginesMeasured, approximateNot countedNot run

Each engine’s Speed score in each matched comparison, out of 100, or why it has none. How rankings work