LFM2.5 2.6B on M5 Max · 64 GiB
Experiment Unsupported Published
uzu 0.6.17 on M5 Max · 64 GiB, Metal
LFM2.5 2.6B as mirai-m (4-bit), archive 256 input / 128 output: a 256-token prompt and 128 tokens out. Measured 12 Nov 2026, 23:02 UTC by Glenn Sonna, Xybrid.
Doesn’t count in rankings: uzu can't run the frozen prompts: Error: uzu counted 23 input tokens, not the frozen prompt's 26 (measured in qualification).
Experiment id s3-lfm2.5-2.6b-4-bit-uzu-256
Unsupported configuration
uzu can't run the frozen prompts: Error: uzu counted 23 input tokens, not the frozen prompt's 26 (measured in qualification).
Caveats
- Publisher cards identify the base model but do not always pin the exact export source checkpoint revision.
- Engines may differ in quantization scheme, effective KV cache precision, kernels, and activations.
Configuration
Device
- Device
- Apple Mac17,6
- Cohort
- Apple silicon Macs (desktop)
- SoC
- Apple M5 Max
- CPU
- 18-core Apple CPU
- GPU
- Not recorded
- NPU
- Not recorded
- RAM
- 64.00 GiB
- OS
- macOS 27.2.0 (26B123)
- Kernel
- 27.2.0
- Power
- mains
- Low power mode
- No
- Performance mode
- Not recorded
Engine
- Engine
- uzu
- Maintainer
- Mirai
- License
- MIT, open source
- Version
- 0.6.17
- Commit
- Not recorded
- Binary SHA-256
- 7829db228dc9c1a80eb71f2146724ab39c37a2dea37aa760b0cb1558b88e4a7c
- Built from
- package
- Build flags
- None
- Backend
- Metal
- Threads
- Not recorded
- Interface
- python-worker
- Settings in effect
- unsupported=uzu can't run the frozen prompts: Error: uzu counted 23 input tokens, not the frozen prompt's 26 (measured in qualification).
Model and weights
- Base model
- LFM2.5 2.6B (LFM2.5, 2.6B)
- Upstream
- LiquidAI/LFM2.5-2.6B@7141b56cd4650af95c7c7b86983443aed050c96a
- Weights
- trymirai/LFM2.5-2.6B-M@424368b3839ed865860deaa1ae3a328db774e93d
- Format
- mirai
- File 1
- README.md · 3,306 bytes · sha256 b0d4d4a6ece347e2bfa92c92c5b324f87f5572fc4c9c3743e60a7393e22e4f9d
- File 2
- config.json · 59,891 bytes · sha256 ae659366b2d7c6c4134c919ed29666dfc0b3c8eadcab00c08e162db276b41671
- File 3
- model.safetensors · 1.36 GiB · sha256 854b40b3dbcc86cb550137eef5d03a00698ad4609fab54a03cc61a86c3cdfc02
- File 4
- tokenizer.json · 17.1 MiB · sha256 695be7802a0e4b8a81048f0ff5ebb7fc811a0ba5a6be63dbb24deb5a81096f41
- Quantization
- mirai-m (4-bit)
- Weight bits
- 4
- Group size
- Not recorded
- KV cache
- uzu default
- Conversion
- Published upstream by trymirai
- Conversion command
- Not recorded
Workload
- Workload
- Archive 256 input / 128 output
- Prompt
- 256 tokens, from prompts/source.txt
- Prompt SHA-256
- c10d1b7bef62d95322f8f8d229dc66118d9375107bdc49b06f76287d058b2f6c
- Chat template
- ea663864491de7ade391839479860ca95541f892f72665c73251fbd4643b1bef
- Output
- 128 tokens, ignoring end of sequence
- Context length
- 4,096
- Batch size
- 1
- Sampling
- Greedy
- Timing
- One streamed request per trial
- Warmup
- 2 runs, not counted
- Trials planned
- 6
- Cooldown
- 15 s between trials
Conditions
- Ambient
- Not recorded
- Thermal at start
- nominal
- Thermal at end
- nominal
- Thermal gate
- macOS thermal state nominal
- Throttling detected
- Not recorded
Provenance
- Measured by
- Glenn Sonna, Xybrid
- Operator affiliation
- Xybrid
- Run at
- 12 Nov 2026, 23:02 UTC
- Harness
- xybrid-bench 0.4.0 (bde6325f3e1d617ca13cbb1d008164ccc9b7b7c3)
- Methodology
- v0.6
- Publication
- published
- Published
- 16 Nov 2026, 10:23 UTC
- Reviewed by
- Glenn Sonna
Output check
- Result
- Not run
- Method
- Not recorded
- Reference
- Not recorded
- Reference SHA-256
- Not recorded
- Required passing checks
- Not recorded
- Detail
- Not recorded
Reproduce it
pnpm bench run --plan plans/s3-lfm2.5-2.6b-4-bit.json
Three palindromic blocks per quantization class and workload; load, two warmups, one trial, unload per turn.
Raw data
- This record, as committed JSON, schema v0.3.0
- Complete finalized session evidence raw ·
sha256 d84c658e7b83…