LFM2.5 2.6B on Pixel 8 · 8 GB

Experiment Failed Published

llama.cpp b12110 on Pixel 8 · 8 GB, CPU

LFM2.5 2.6B as Q8_0 (8-bit), archive 2048 input / 128 output: a 2048-token prompt and 128 tokens out. Measured 13 Nov 2026, 02:26 UTC by Glenn Sonna, Xybrid.

Doesn’t count in rankings: No trial was valid.

Experiment id s4-pixel8-lfm2.5-2.6b-8-bit-llama-2048

Errors

  • trial: No trial was valid.
  • trial: No trial was valid.
  • trial: No trial was valid.
  • trial: No trial was valid.
  • trial: No trial was valid.
  • trial: No trial was valid.

Summary

Over 0 valid trials of 6 attempted (6 planned), computed from the raw trials below.

MetricMedianRangeMean ± SDQuartiles
Decode speed tok/s, higher is betterNot measured
Time to first token ms, lower is betterNot measured
Peak memory GiB, lower is betterNot measured
Prefill speed tok/s, higher is betterNot measured

Trials, metric by metric

The line runs from the lowest to the highest valid trial, the dot is the median and each tick is one trial.

Decode speed tok/s, higher is better
Time to first token ms, lower is better
Peak memory GiB, lower is better
Prefill speed tok/s, higher is better

Every trial

Raw token counts and durations, with the speeds computed from them. Invalid trials stay in the record with their reason; they are left out of the summary, never silently dropped.

Every attempted trial
TrialTime to first token msPrefill tok/sDecode tok/sPeak memory GiBThermalNote
1Invalid45,26045.32,048 tok in 45,235 ms, engine6.8127 tok in 18,775 ms, enginenot recorded37.0 °C, nominal → 40.6 °C, lightThe measurement interval lacks nominal thermal evidence or reported throttling. The device reported thermal throttling during the trial.
2Invalid45,35145.22,048 tok in 45,319 ms, engine6.7127 tok in 18,873 ms, enginenot recorded36.9 °C, nominal → 40.4 °C, lightThe measurement interval lacks nominal thermal evidence or reported throttling. The device reported thermal throttling during the trial.
3Invalid45,00845.52,048 tok in 44,981 ms, engine6.5127 tok in 19,394 ms, enginenot recorded36.8 °C, nominal → 40.4 °C, lightThe measurement interval lacks nominal thermal evidence or reported throttling. The device reported thermal throttling during the trial.
4Invalid44,92245.62,048 tok in 44,891 ms, engine6.6127 tok in 19,159 ms, enginenot recorded36.6 °C, nominal → 40.3 °C, lightThe measurement interval lacks nominal thermal evidence or reported throttling. The device reported thermal throttling during the trial.
5Invalid45,03645.52,048 tok in 45,009 ms, engine6.6127 tok in 19,225 ms, enginenot recorded36.7 °C, nominal → 40.4 °C, lightThe measurement interval lacks nominal thermal evidence or reported throttling. The device reported thermal throttling during the trial.
6Invalid45,48045.12,048 tok in 45,450 ms, engine6.6127 tok in 19,382 ms, enginenot recorded37.0 °C, nominal → 40.4 °C, lightThe measurement interval lacks nominal thermal evidence or reported throttling. The device reported thermal throttling during the trial.

Caveats

  • Publisher cards identify the base model but do not always pin the exact export source checkpoint revision.
  • Engines may differ in quantization scheme, effective KV cache precision, kernels, and activations.

Configuration

Device

Device
Google Pixel 8
Cohort
Android phones (mobile)
SoC
Google Tensor G3
CPU
9-core CPU (1× Cortex-X3, 4× Cortex-A715, 4× Cortex-A510)
GPU
Arm Mali-G715
NPU
Not recorded
RAM
8.00 GiB
OS
Android 16 (CP1A.260505.005)
Kernel
6.1.145-android14-11-gfa1d6308d1fe-ab14691759
Power
mains
Low power mode
No
Wakefulness
awake

Engine

Engine
llama.cpp
Maintainer
ggml-org
License
MIT, open source
Version
b12110
Commit
cd959bae9
Binary SHA-256
db82377125f69e87c06b402bba1af072e2a4c4cc9945946e4d6378cc213a84d7
Built from
release
Build flags
None
Backend
CPU
Threads
Not recorded
Interface
http-server
Settings in effect
context_length=4096 parallel=1 speculative=false backend=cpu launch.log_verbosity=4 launch.log_colors=off launch.cache_prompt=false launch.cache_ram_mib=0 launch.cache_reuse=0 launch.continuous_batching=false launch.context_shift=false launch.flash_attn=on launch.cache_type_k=f16 launch.cache_type_v=f16 launch.gpu_layers=0 launch.load_mode=mmap offloaded_layers=0 launch.mmap=true n_batch=2048 n_ubatch=512 n_threads=9 n_threads_batch=9 flash_attn=enabled

Model and weights

Base model
LFM2.5 2.6B (LFM2.5, 2.6B)
Upstream
LiquidAI/LFM2.5-2.6B@7141b56cd4650af95c7c7b86983443aed050c96a
Weights
LiquidAI/LFM2.5-2.6B-GGUF@e7caca5d835a3901a8e0d63e94009429bafafdfc
Format
gguf
File 1
LFM2.5-2.6B-Q8_0.gguf · 2.68 GiB · sha256 1e22128dfa128bdfb684da167e74e072d0a056baa7d06d9f280291e2839b0fc9
File 2
README.md · 3,068 bytes · sha256 d08b79260b3998e96792777085e4175b730667568f3a953ad4ac9099cfa27056
Quantization
Q8_0 (8-bit)
Weight bits
8
Group size
32
KV cache
f16
Conversion
Published upstream by LiquidAI
Conversion command
Not recorded

Workload

Workload
Archive 2048 input / 128 output
Prompt
2,048 tokens, from prompts/source.txt
Prompt SHA-256
c10d1b7bef62d95322f8f8d229dc66118d9375107bdc49b06f76287d058b2f6c
Chat template
ea663864491de7ade391839479860ca95541f892f72665c73251fbd4643b1bef
Output
128 tokens, ignoring end of sequence
Context length
4,096
Batch size
1
Sampling
Greedy
Timing
One streamed request per trial
Warmup
2 runs, not counted
Trials planned
6
Cooldown
60 s between trials

Conditions

Ambient
Not recorded
Thermal at start
35.4 °C, nominal
Thermal at end
40.4 °C, light
Thermal gate
Android thermal status none (0)
Throttling detected
Yes

Provenance

Measured by
Glenn Sonna, Xybrid
Operator affiliation
Xybrid
Run at
13 Nov 2026, 02:26 UTC
Harness
xybrid-bench 0.4.0 (3d9b4e6edd5a0d4463e6585c07504f7db77c3efb)
Methodology
v0.6
Publication
published
Published
16 Nov 2026, 10:23 UTC
Reviewed by
Glenn Sonna

Output check

Result
Passed
Method
sanity-v1-bf16-reference
Reference
checks/sanity-v1.json
Reference SHA-256
a702dee079525ae0ec90465b1c9e26052c99cb3e1c53e83dea05be4c194fc7ca
Required passing checks
8
Check arithmetic
Passed · sha256 68ce25cb2c4b530f85434cd352428b022149c641163300e566f4f9ee9d789bcf
Check capital
Passed · sha256 b1098d691672b55e98767ac84c6d8375f7bcc0d78154c861ea70ac2ff66e0ba7
Check opposite
Passed · sha256 7c90b06eef25984adf77ec226311829bbc1065a033e9ad6b26d9bd0dfdc65f95
Check weekday
Passed · sha256 03db656ee680fb1053be9c98631722488bb10269075159dbae5b000f0359dae2
Check color
Failed · sha256 a4849893c59e4aa15ff645cadd4cce0fbd882097352a75d8e6f23619578a73c6
Check sort
Failed · sha256 6904619ddb316a20bc1220a9088da9a4181f1f16766b6fdd188defd9cddc4c75
Check animal
Passed · sha256 3e9114b6df29561433c18b3a6abce2c635fbd8e9ff25b5fcee93149bfea52859
Check word
Passed · sha256 d1bf31457072aaa4c116ea5819a644456232fdd87b15203d3eafdd5e541f4e61
Check copy
Passed · sha256 d8c711dfa5fef68d1d0f86320daeca065b91bc8d0dbcea210f8b9ef80eefc6c2
Check needle-start
Passed · sha256 56a69645d0ff053b3b7001c224f07a374bf963a22c9fa4706dda5e56e3616870
Check needle-end
Failed · sha256 5a09189f964d565107e0d6ae15cb5b517d18fb1de4e9d300f822e4d3afa34643
Check continuation-128
Passed · sha256 35b435d7f1c75bb05c07d58cad000525a1d62d6dbe7fd00ae7416953dfa26286
Detail
9/9 of the checks the model passes at BF16; needs 8 and the mandatory ones (needle-start, continuation-128). Left out, failed by every BF16 configuration: color, sort, needle-end.

Reproduce it

Commands
pnpm bench run --plan plans/s4-pixel8-lfm2.5-2.6b-8-bit.json

Three palindromic blocks per quantization class and workload; load, two warmups, one trial, unload per turn.

Raw data