Rankings

Engine

ZML

ZML · Apache-2.0, open source · Homepage

Top Engines

Desktop
Not ranked Results in 0 of 4 comparisons; a rank needs all 4.
Mobile
Not measured
details

Approximate comparison: The experiments use different effective KV cache precision: f16, magnitude default, model-dtype, zml default. Its phases were timed by the harness clock around the engine API, so they include transport that engine counters leave out.

How rankings work

Supporting experiments

ZML: every experiment, grouped by matched comparison. Medians over valid trials.
ConfigurationStatusGenerationtok/sFirst tokenmsPrefilltok/sMemoryGiB
LFM2.5 1.2B Instruct on M5 Max · 64 GiB bf16 · Archive 256 input / 128 output · macOS 27 Speed score 96, approximate comparison
LFM2.5 1.2B Instruct on M5 Max · 64 GiB, bf16 · Archive 256 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 6/6 validCounted 192.6range147.6–193.324.9range24.8–26.510,269range9,659–10,3364.93range4.72–4.99
LFM2.5 2.6B on M5 Max · 64 GiB bf16 · Archive 256 input / 128 output · macOS 27
LFM2.5 2.6B on M5 Max · 64 GiB, bf16 · Archive 256 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 0/6 validUnsupported Not measuredNot measuredNot measuredNot measured
LFM2.5 350M on M5 Max · 64 GiB bf16 · Archive 256 input / 128 output · macOS 27 Speed score 73, approximate comparison
LFM2.5 350M on M5 Max · 64 GiB, bf16 · Archive 256 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 6/6 validCounted 420.2range417.3–422.515.9range14.9–16.216,085range15,849–17,2184.89range4.85–4.94
LFM2.5 1.2B Instruct on M5 Max · 64 GiB bf16 · Archive 2048 input / 128 output · macOS 27 Speed score 76, approximate comparison
LFM2.5 1.2B Instruct on M5 Max · 64 GiB, bf16 · Archive 2048 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 6/6 validCounted 150.9range145.2–151.6130range129–13015,773range15,697–15,9014.75range4.72–4.94
LFM2.5 2.6B on M5 Max · 64 GiB bf16 · Archive 2048 input / 128 output · macOS 27
LFM2.5 2.6B on M5 Max · 64 GiB, bf16 · Archive 2048 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 0/6 validUnsupported Not measuredNot measuredNot measuredNot measured
LFM2.5 350M on M5 Max · 64 GiB bf16 · Archive 2048 input / 128 output · macOS 27 Speed score 49, approximate comparison
LFM2.5 350M on M5 Max · 64 GiB, bf16 · Archive 2048 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 6/6 validCounted 261.0range259.0–263.359.6range59.2–60.234,342range34,045–34,5754.87range4.74–4.91