Rankings
Engine
ZML
ZML · Apache-2.0, open source · Homepage
Top Engines
- Desktop
- Not ranked
- Mobile
- Not measured
details
Approximate comparison: The experiments use different effective KV cache precision: f16, magnitude default, model-dtype, zml default. Its phases were timed by the harness clock around the engine API, so they include transport that engine counters leave out.
Supporting experiments
| Configuration | Status | Generationtok/s | First tokenms | Prefilltok/s | MemoryGiB |
|---|---|---|---|---|---|
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB bf16 · Archive 256 input / 128 output · macOS 27 Speed score 96, approximate comparison | |||||
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB, bf16 · Archive 256 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 6/6 valid | Counted | 192.6range147.6–193.3 | 24.9range24.8–26.5 | 10,269range9,659–10,336 | 4.93range4.72–4.99 |
| LFM2.5 2.6B on M5 Max · 64 GiB bf16 · Archive 256 input / 128 output · macOS 27 | |||||
| LFM2.5 2.6B on M5 Max · 64 GiB, bf16 · Archive 256 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 350M on M5 Max · 64 GiB bf16 · Archive 256 input / 128 output · macOS 27 Speed score 73, approximate comparison | |||||
| LFM2.5 350M on M5 Max · 64 GiB, bf16 · Archive 256 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 6/6 valid | Counted | 420.2range417.3–422.5 | 15.9range14.9–16.2 | 16,085range15,849–17,218 | 4.89range4.85–4.94 |
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB bf16 · Archive 2048 input / 128 output · macOS 27 Speed score 76, approximate comparison | |||||
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB, bf16 · Archive 2048 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 6/6 valid | Counted | 150.9range145.2–151.6 | 130range129–130 | 15,773range15,697–15,901 | 4.75range4.72–4.94 |
| LFM2.5 2.6B on M5 Max · 64 GiB bf16 · Archive 2048 input / 128 output · macOS 27 | |||||
| LFM2.5 2.6B on M5 Max · 64 GiB, bf16 · Archive 2048 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 350M on M5 Max · 64 GiB bf16 · Archive 2048 input / 128 output · macOS 27 Speed score 49, approximate comparison | |||||
| LFM2.5 350M on M5 Max · 64 GiB, bf16 · Archive 2048 input / 128 output · macOS 27: 20261106.0 · Metal BF16 · 6/6 valid | Counted | 261.0range259.0–263.3 | 59.6range59.2–60.2 | 34,342range34,045–34,575 | 4.87range4.74–4.91 |