Ternary Bonsai 2 27B on M5 Max · 64 GiB
Experiment Unsupported Published
Magnitude 0.2.17 on M5 Max · 64 GiB, Metal
Ternary Bonsai 2 27B as Q2_0 (2-bit), archive 2048 input / 128 output: a 2048-token prompt and 128 tokens out. Measured 9 Nov 2026, 23:21 UTC by Glenn Sonna, Xybrid.
Doesn’t count in rankings: Magnitude 0.2.17 reports this GGUF as Unsupported (magnitude catalog inspect)
Experiment id s2-bonsai2-27b-2-bit-magnitude-2048
Unsupported configuration
Magnitude 0.2.17 reports this GGUF as Unsupported (magnitude catalog inspect)
Caveats
- Publisher cards identify the base model but do not always pin the exact export source checkpoint revision.
- Engines may differ in quantization scheme, effective KV cache precision, kernels, and activations.
Configuration
Device
- Device
- Apple Mac17,6
- Cohort
- Apple silicon Macs (desktop)
- SoC
- Apple M5 Max
- CPU
- 18-core Apple CPU
- GPU
- Not recorded
- NPU
- Not recorded
- RAM
- 64.00 GiB
- OS
- macOS 27.2.0 (26B123)
- Kernel
- 27.2.0
- Power
- mains
- Low power mode
- No
- Performance mode
- Not recorded
Engine
- Engine
- Magnitude
- Maintainer
- Magnitude
- License
- Apache-2.0, open source
- Version
- 0.2.17
- Commit
- Not recorded
- Binary SHA-256
- 1cf3297910bc71b824c68461b1c45ecc85dc1942ba91fb67ac3a6d1dfd3de353
- Built from
- release
- Build flags
- None
- Backend
- Metal
- Threads
- Not recorded
- Interface
- http-server
- Settings in effect
- chat_prefix=<|im_start|>user chat_suffix=<|im_end|> <|im_start|>assistant <think> </think> magnitude_supported=false
Model and weights
- Base model
- Ternary Bonsai 2 27B (Bonsai, 27B)
- Upstream
- prism-ml/Ternary-Bonsai-2-27B-gguf@839bd57023c1558945afea70a74fa83c054f35f9
- Weights
- prism-ml/Ternary-Bonsai-2-27B-gguf@839bd57023c1558945afea70a74fa83c054f35f9
- Format
- gguf
- File 1
- README.md · 24,367 bytes · sha256 57fa037cfa812c9e6872e970c963d5227904eade7dda064019ae2a3fd140b500
- File 2
- Ternary-Bonsai-2-27B-Q2_0.gguf · 7.10 GiB · sha256 4f99aed01b8a877e153f9aa6569a4440fe17c59701cc0953e36d7f460549e70e
- Quantization
- Q2_0 (2-bit)
- Weight bits
- 2
- Group size
- Not recorded
- KV cache
- magnitude default
- Conversion
- Published upstream by prism-ml
- Conversion command
- Not recorded
Workload
- Workload
- Archive 2048 input / 128 output
- Prompt
- 2,048 tokens, from prompts/source.txt
- Prompt SHA-256
- c10d1b7bef62d95322f8f8d229dc66118d9375107bdc49b06f76287d058b2f6c
- Chat template
- c3cf9e34abf4f9e36c2d72165aa9c132d3e2a725b6c2586aaa3a8af9d7a81041
- Output
- 128 tokens, ignoring end of sequence
- Context length
- 4,096
- Batch size
- 1
- Sampling
- Greedy
- Timing
- One streamed request per trial
- Warmup
- 2 runs, not counted
- Trials planned
- 6
- Cooldown
- 15 s between trials
Conditions
- Ambient
- Not recorded
- Thermal at start
- nominal
- Thermal at end
- nominal
- Thermal gate
- macOS thermal state nominal
- Throttling detected
- Not recorded
Provenance
- Measured by
- Glenn Sonna, Xybrid
- Operator affiliation
- Xybrid
- Run at
- 9 Nov 2026, 23:21 UTC
- Harness
- xybrid-bench 0.4.0 (103beb8cf54e7e006744c19f3189370cd245047e)
- Methodology
- v0.6
- Publication
- published
- Published
- 16 Nov 2026, 10:23 UTC
- Reviewed by
- Glenn Sonna
Output check
- Result
- Not run
- Method
- Not recorded
- Reference
- Not recorded
- Reference SHA-256
- Not recorded
- Required passing checks
- Not recorded
- Detail
- Not recorded
Reproduce it
pnpm bench run --plan plans/s2-bonsai2-27b-2-bit.json
Three palindromic blocks per quantization class and workload; load, two warmups, one trial, unload per turn.
Raw data
- This record, as committed JSON, schema v0.3.0
- Complete finalized session evidence raw ·
sha256 41452a1391ce…