Engine
uzu
Mirai · MIT, open source · Homepage
Top Engines
- Desktop
- Not ranked
- Mobile
- Not ranked
details
Approximate comparison: The experiments use different effective KV cache precision: bf16, fp32, litert-lm default, f16, magnitude default, model-dtype, uzu default. Its weights are 4-bit in another scheme: mirai-m, where most use Q4_K_M. The experiments use different effective KV cache precision: litert-lm default, f16, magnitude default, model-dtype, uzu default. Its weights are 8-bit in another scheme: mirai-l, where most use Q8_0. The experiments use different effective KV cache precision: fp32, f16, uzu default. The experiments here use different 4-bit schemes: 8da4w, Q4_K_M, mirai-m. The experiments use different effective KV cache precision: f16, uzu default. The experiments here use different 8-bit schemes: Q8_0, mirai-l.
Supporting experiments
| Configuration | Status | Generationtok/s | First tokenms | Prefilltok/s | MemoryGiB |
|---|---|---|---|---|---|
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB 4-bit · Archive 256 input / 128 output · macOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB, 4-bit · Archive 256 input / 128 output · macOS 27: 0.6.17 · Metal mirai-m · 6/6 valid | Counted | 540.7range539.8–541.4 | 75.2range74.9–76.9 | 13,205range13,070–13,700 | 0.90range0.90–0.96 |
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB 8-bit · Archive 256 input / 128 output · macOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB, 8-bit · Archive 256 input / 128 output · macOS 27: 0.6.17 · Metal mirai-l · 6/6 valid | Counted | 374.3range373.4–374.7 | 75.1range74.3–76.5 | 13,385range13,101–14,426 | 1.46range1.46–1.52 |
| LFM2.5 2.6B on M5 Max · 64 GiB 8-bit · Archive 256 input / 128 output · macOS 27 | |||||
| LFM2.5 2.6B on M5 Max · 64 GiB, 8-bit · Archive 256 input / 128 output · macOS 27: 0.6.17 · Metal mirai-l · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 350M on M5 Max · 64 GiB 4-bit · Archive 256 input / 128 output · macOS 27 Speed score 90, approximate comparison | |||||
| LFM2.5 350M on M5 Max · 64 GiB, 4-bit · Archive 256 input / 128 output · macOS 27: 0.6.17 · Metal mirai-m · 6/6 valid | Counted | 1,001range996.6–1,003 | 67.9range67.2–68.7 | 19,884range19,381–20,825 | 0.48range0.48–0.53 |
| LFM2.5 350M on M5 Max · 64 GiB 8-bit · Archive 256 input / 128 output · macOS 27 Speed score 97, approximate comparison | |||||
| LFM2.5 350M on M5 Max · 64 GiB, 8-bit · Archive 256 input / 128 output · macOS 27: 0.6.17 · Metal mirai-l · 6/6 valid | Counted | 794.4range790.4–795.5 | 69.2range66.9–71.4 | 19,693range18,755–20,523 | 0.67range0.67–0.71 |
| Qwen3.8 27B on M5 Max · 64 GiB 4-bit · Archive 256 input / 128 output · macOS 27 | |||||
| Qwen3.8 27B on M5 Max · 64 GiB, 4-bit · Archive 256 input / 128 output · macOS 27: 0.6.17 · Metal mirai-m · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| Qwen3.8 27B on M5 Max · 64 GiB 8-bit · Archive 256 input / 128 output · macOS 27 | |||||
| Qwen3.8 27B on M5 Max · 64 GiB, 8-bit · Archive 256 input / 128 output · macOS 27: 0.6.17 · Metal mirai-l · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB 4-bit · Archive 2048 input / 128 output · macOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB, 4-bit · Archive 2048 input / 128 output · macOS 27: 0.6.17 · Metal mirai-m · 6/6 valid | Counted | 528.7range525.9–529.0 | 126range124–130 | 31,301range31,245–31,611 | 0.95range0.95–0.95 |
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB 8-bit · Archive 2048 input / 128 output · macOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 1.2B Instruct on M5 Max · 64 GiB, 8-bit · Archive 2048 input / 128 output · macOS 27: 0.6.17 · Metal mirai-l · 6/6 valid | Counted | 368.8range368.5–369.0 | 127range126–130 | 30,505range30,394–30,625 | 1.51range1.51–1.51 |
| LFM2.5 2.6B on M5 Max · 64 GiB 8-bit · Archive 2048 input / 128 output · macOS 27 | |||||
| LFM2.5 2.6B on M5 Max · 64 GiB, 8-bit · Archive 2048 input / 128 output · macOS 27: 0.6.17 · Metal mirai-l · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 350M on M5 Max · 64 GiB 4-bit · Archive 2048 input / 128 output · macOS 27 | |||||
| LFM2.5 350M on M5 Max · 64 GiB, 4-bit · Archive 2048 input / 128 output · macOS 27: 0.6.17 · Metal mirai-m · 0/6 valid | Failed | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 350M on M5 Max · 64 GiB 8-bit · Archive 2048 input / 128 output · macOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 350M on M5 Max · 64 GiB, 8-bit · Archive 2048 input / 128 output · macOS 27: 0.6.17 · Metal mirai-l · 6/6 valid | Counted | 776.1range771.4–779.6 | 88.8range86.9–90.3 | 66,557range65,117–71,324 | 0.70range0.70–0.71 |
| Qwen3.8 27B on M5 Max · 64 GiB 4-bit · Archive 2048 input / 128 output · macOS 27 | |||||
| Qwen3.8 27B on M5 Max · 64 GiB, 4-bit · Archive 2048 input / 128 output · macOS 27: 0.6.17 · Metal mirai-m · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| Qwen3.8 27B on M5 Max · 64 GiB 8-bit · Archive 2048 input / 128 output · macOS 27 | |||||
| Qwen3.8 27B on M5 Max · 64 GiB, 8-bit · Archive 2048 input / 128 output · macOS 27: 0.6.17 · Metal mirai-l · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 1.2B Instruct on iPhone 12 · 4 GB 4-bit · Archive 256 input / 128 output · iOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 1.2B Instruct on iPhone 12 · 4 GB, 4-bit · Archive 256 input / 128 output · iOS 27: 0.6.17 · Metal mirai-m · 6/6 valid | Counted | 45.4range44.4–46.0 | 1,073range1,055–1,117 | 257.7range257.1–259.1 | Not measured |
| LFM2.5 1.2B Instruct on iPhone 12 · 4 GB 8-bit · Archive 256 input / 128 output · iOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 1.2B Instruct on iPhone 12 · 4 GB, 8-bit · Archive 256 input / 128 output · iOS 27: 0.6.17 · Metal mirai-l · 6/6 valid | Counted | 25.7range25.4–25.8 | 1,048range1,032–1,110 | 260.0range258.8–262.3 | Not measured |
| LFM2.5 350M on iPhone 12 · 4 GB 4-bit · Archive 256 input / 128 output · iOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 350M on iPhone 12 · 4 GB, 4-bit · Archive 256 input / 128 output · iOS 27: 0.6.17 · Metal mirai-m · 6/6 valid | Counted | 130.8range126.8–131.2 | 384range379–400 | 786.2range777.4–795.5 | Not measured |
| LFM2.5 350M on iPhone 12 · 4 GB 8-bit · Archive 256 input / 128 output · iOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 350M on iPhone 12 · 4 GB, 8-bit · Archive 256 input / 128 output · iOS 27: 0.6.17 · Metal mirai-l · 6/6 valid | Counted | 74.8range73.9–75.4 | 383range373–399 | 789.4range783.3–802.6 | Not measured |
| LFM2.5 350M on iPhone 12 · 4 GB 8-bit · Archive 2048 input / 128 output · iOS 27 Speed score 100, approximate comparison | |||||
| LFM2.5 350M on iPhone 12 · 4 GB, 8-bit · Archive 2048 input / 128 output · iOS 27: 0.6.17 · Metal mirai-l · 6/6 valid | Counted | 70.2range68.8–71.0 | 2,356range2,346–2,395 | 895.5range894.2–897.8 | Not measured |
| LFM2.5 2.6B on M5 Max · 64 GiB 4-bit · Archive 256 input / 128 output · macOS 27 Not counted | |||||
| LFM2.5 2.6B on M5 Max · 64 GiB, 4-bit · Archive 256 input / 128 output · macOS 27: 0.6.17 · Metal mirai-m · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 2.6B on M5 Max · 64 GiB 4-bit · Archive 2048 input / 128 output · macOS 27 Not counted | |||||
| LFM2.5 2.6B on M5 Max · 64 GiB, 4-bit · Archive 2048 input / 128 output · macOS 27: 0.6.17 · Metal mirai-m · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 2.6B on iPhone 12 · 4 GB 4-bit · Archive 256 input / 128 output · iOS 27 Not counted | |||||
| LFM2.5 2.6B on iPhone 12 · 4 GB, 4-bit · Archive 256 input / 128 output · iOS 27: 0.6.17 · Metal mirai-m · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 2.6B on iPhone 12 · 4 GB 8-bit · Archive 256 input / 128 output · iOS 27 Not counted | |||||
| LFM2.5 2.6B on iPhone 12 · 4 GB, 8-bit · Archive 256 input / 128 output · iOS 27: 0.6.17 · Metal mirai-l · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 1.2B Instruct on iPhone 12 · 4 GB 4-bit · Archive 2048 input / 128 output · iOS 27 Not counted | |||||
| LFM2.5 1.2B Instruct on iPhone 12 · 4 GB, 4-bit · Archive 2048 input / 128 output · iOS 27: 0.6.17 · Metal mirai-m · 4/6 valid | Partial | 42.3range41.9–42.6 | 7,784range7,768–8,145 | 265.3range253.4–265.9 | Not measured |
| LFM2.5 1.2B Instruct on iPhone 12 · 4 GB 8-bit · Archive 2048 input / 128 output · iOS 27 Not counted | |||||
| LFM2.5 1.2B Instruct on iPhone 12 · 4 GB, 8-bit · Archive 2048 input / 128 output · iOS 27: 0.6.17 · Metal mirai-l · 2/6 valid | Partial | 24.7range24.7–24.8 | 7,790range7,709–7,871 | 265.1range262.3–267.8 | Not measured |
| LFM2.5 2.6B on iPhone 12 · 4 GB 4-bit · Archive 2048 input / 128 output · iOS 27 Not counted | |||||
| LFM2.5 2.6B on iPhone 12 · 4 GB, 4-bit · Archive 2048 input / 128 output · iOS 27: 0.6.17 · Metal mirai-m · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 2.6B on iPhone 12 · 4 GB 8-bit · Archive 2048 input / 128 output · iOS 27 Not counted | |||||
| LFM2.5 2.6B on iPhone 12 · 4 GB, 8-bit · Archive 2048 input / 128 output · iOS 27: 0.6.17 · Metal mirai-l · 0/6 valid | Unsupported | Not measured | Not measured | Not measured | Not measured |
| LFM2.5 350M on iPhone 12 · 4 GB 4-bit · Archive 2048 input / 128 output · iOS 27 Not counted | |||||
| LFM2.5 350M on iPhone 12 · 4 GB, 4-bit · Archive 2048 input / 128 output · iOS 27: 0.6.17 · Metal mirai-m · 0/6 valid | Failed | Not measured | Not measured | Not measured | Not measured |