Ternary Bonsai 2 27B on M5 Max · 64 GiB

Experiment Unsupported Published

Magnitude 0.2.17 on M5 Max · 64 GiB, Metal

Ternary Bonsai 2 27B as Q2_0 (2-bit), archive 256 input / 128 output: a 256-token prompt and 128 tokens out. Measured 9 Nov 2026, 23:08 UTC by Glenn Sonna, Xybrid.

Doesn’t count in rankings: Magnitude 0.2.17 reports this GGUF as Unsupported (magnitude catalog inspect)

Experiment id s2-bonsai2-27b-2-bit-magnitude-256

Unsupported configuration

Magnitude 0.2.17 reports this GGUF as Unsupported (magnitude catalog inspect)

Caveats

  • Publisher cards identify the base model but do not always pin the exact export source checkpoint revision.
  • Engines may differ in quantization scheme, effective KV cache precision, kernels, and activations.

Configuration

Device

Device
Apple Mac17,6
Cohort
Apple silicon Macs (desktop)
SoC
Apple M5 Max
CPU
18-core Apple CPU
GPU
Not recorded
NPU
Not recorded
RAM
64.00 GiB
OS
macOS 27.2.0 (26B123)
Kernel
27.2.0
Power
mains
Low power mode
No
Performance mode
Not recorded

Engine

Engine
Magnitude
Maintainer
Magnitude
License
Apache-2.0, open source
Version
0.2.17
Commit
Not recorded
Binary SHA-256
1cf3297910bc71b824c68461b1c45ecc85dc1942ba91fb67ac3a6d1dfd3de353
Built from
release
Build flags
None
Backend
Metal
Threads
Not recorded
Interface
http-server
Settings in effect
chat_prefix=<|im_start|>user chat_suffix=<|im_end|> <|im_start|>assistant <think> </think> magnitude_supported=false

Model and weights

Base model
Ternary Bonsai 2 27B (Bonsai, 27B)
Upstream
prism-ml/Ternary-Bonsai-2-27B-gguf@839bd57023c1558945afea70a74fa83c054f35f9
Weights
prism-ml/Ternary-Bonsai-2-27B-gguf@839bd57023c1558945afea70a74fa83c054f35f9
Format
gguf
File 1
README.md · 24,367 bytes · sha256 57fa037cfa812c9e6872e970c963d5227904eade7dda064019ae2a3fd140b500
File 2
Ternary-Bonsai-2-27B-Q2_0.gguf · 7.10 GiB · sha256 4f99aed01b8a877e153f9aa6569a4440fe17c59701cc0953e36d7f460549e70e
Quantization
Q2_0 (2-bit)
Weight bits
2
Group size
Not recorded
KV cache
magnitude default
Conversion
Published upstream by prism-ml
Conversion command
Not recorded

Workload

Workload
Archive 256 input / 128 output
Prompt
256 tokens, from prompts/source.txt
Prompt SHA-256
c10d1b7bef62d95322f8f8d229dc66118d9375107bdc49b06f76287d058b2f6c
Chat template
c3cf9e34abf4f9e36c2d72165aa9c132d3e2a725b6c2586aaa3a8af9d7a81041
Output
128 tokens, ignoring end of sequence
Context length
4,096
Batch size
1
Sampling
Greedy
Timing
One streamed request per trial
Warmup
2 runs, not counted
Trials planned
6
Cooldown
15 s between trials

Conditions

Ambient
Not recorded
Thermal at start
nominal
Thermal at end
nominal
Thermal gate
macOS thermal state nominal
Throttling detected
Not recorded

Provenance

Measured by
Glenn Sonna, Xybrid
Operator affiliation
Xybrid
Run at
9 Nov 2026, 23:08 UTC
Harness
xybrid-bench 0.4.0 (103beb8cf54e7e006744c19f3189370cd245047e)
Methodology
v0.6
Publication
published
Published
16 Nov 2026, 10:23 UTC
Reviewed by
Glenn Sonna

Output check

Result
Not run
Method
Not recorded
Reference
Not recorded
Reference SHA-256
Not recorded
Required passing checks
Not recorded
Detail
Not recorded

Reproduce it

Commands
pnpm bench run --plan plans/s2-bonsai2-27b-2-bit.json

Three palindromic blocks per quantization class and workload; load, two warmups, one trial, unload per turn.

Raw data