LFM2.5 2.6B on Pixel 8 · 8 GB

Experiment Partial Published

llama.cpp b12110 on Pixel 8 · 8 GB, CPU

LFM2.5 2.6B as Q8_0 (8-bit), archive 256 input / 128 output: a 256-token prompt and 128 tokens out. Measured 13 Nov 2026, 01:45 UTC by Glenn Sonna, Xybrid.

Doesn’t count in rankings: Partial: 4 of 6 planned trials were valid.

Experiment id s4-pixel8-lfm2.5-2.6b-8-bit-llama-256

Errors

  • trial: No trial was valid.
  • trial: No trial was valid.

Summary

Over 4 valid trials of 6 attempted (6 planned), computed from the raw trials below.

MetricMedianRangeMean ± SDQuartiles
Decode speed tok/s, higher is better7.1 6.8–7.5 7.2 ± 0.3 7.0–7.3
Time to first token ms, lower is better3,990 3,925–5,743 4,412 ± 888 3,968–4,434
Peak memory GiB, lower is betterNot measured
Prefill speed tok/s, higher is better64.5 44.8–65.5 59.8 ± 10.1 59.5–64.9

Trials, metric by metric

The line runs from the lowest to the highest valid trial, the dot is the median and each tick is one trial.

Decode speed tok/s, higher is better
Time to first token ms, lower is better
Peak memory GiB, lower is better
Prefill speed tok/s, higher is better

Every trial

Raw token counts and durations, with the speeds computed from them. Invalid trials stay in the record with their reason; they are left out of the summary, never silently dropped.

Every attempted trial
TrialTime to first token msPrefill tok/sDecode tok/sPeak memory GiBThermalNote
1Invalid4,11362.5256 tok in 4,093 ms, engine6.1127 tok in 20,660 ms, enginenot recorded36.9 °C, nominal → 39.2 °C, lightThe measurement interval lacks nominal thermal evidence or reported throttling. The device reported thermal throttling during the trial.
23,98264.7256 tok in 3,959 ms, engine7.0127 tok in 18,114 ms, enginenot recorded36.5 °C, nominal → 38.3 °C, nominal
33,92565.5256 tok in 3,911 ms, engine7.5127 tok in 16,830 ms, enginenot recorded36.5 °C, nominal → 37.9 °C, nominal
45,74344.8256 tok in 5,719 ms, engine6.8127 tok in 18,642 ms, enginenot recorded36.9 °C, nominal → 38.2 °C, nominal
5Invalid6,85037.5256 tok in 6,829 ms, engine6.0127 tok in 21,327 ms, enginenot recorded36.7 °C, nominal → 39.2 °C, lightThe measurement interval lacks nominal thermal evidence or reported throttling. The device reported thermal throttling during the trial.
63,99864.4256 tok in 3,974 ms, engine7.3127 tok in 17,456 ms, enginenot recorded36.3 °C, nominal → 38.3 °C, nominal

Caveats

  • Publisher cards identify the base model but do not always pin the exact export source checkpoint revision.
  • Engines may differ in quantization scheme, effective KV cache precision, kernels, and activations.

Configuration

Device

Device
Google Pixel 8
Cohort
Android phones (mobile)
SoC
Google Tensor G3
CPU
9-core CPU (1× Cortex-X3, 4× Cortex-A715, 4× Cortex-A510)
GPU
Arm Mali-G715
NPU
Not recorded
RAM
8.00 GiB
OS
Android 16 (CP1A.260505.005)
Kernel
6.1.145-android14-11-gfa1d6308d1fe-ab14691759
Power
mains
Low power mode
No
Wakefulness
awake

Engine

Engine
llama.cpp
Maintainer
ggml-org
License
MIT, open source
Version
b12110
Commit
cd959bae9
Binary SHA-256
db82377125f69e87c06b402bba1af072e2a4c4cc9945946e4d6378cc213a84d7
Built from
release
Build flags
None
Backend
CPU
Threads
Not recorded
Interface
http-server
Settings in effect
context_length=4096 parallel=1 speculative=false backend=cpu launch.log_verbosity=4 launch.log_colors=off launch.cache_prompt=false launch.cache_ram_mib=0 launch.cache_reuse=0 launch.continuous_batching=false launch.context_shift=false launch.flash_attn=on launch.cache_type_k=f16 launch.cache_type_v=f16 launch.gpu_layers=0 launch.load_mode=mmap offloaded_layers=0 launch.mmap=true n_batch=2048 n_ubatch=512 n_threads=9 n_threads_batch=9 flash_attn=enabled

Model and weights

Base model
LFM2.5 2.6B (LFM2.5, 2.6B)
Upstream
LiquidAI/LFM2.5-2.6B@7141b56cd4650af95c7c7b86983443aed050c96a
Weights
LiquidAI/LFM2.5-2.6B-GGUF@e7caca5d835a3901a8e0d63e94009429bafafdfc
Format
gguf
File 1
LFM2.5-2.6B-Q8_0.gguf · 2.68 GiB · sha256 1e22128dfa128bdfb684da167e74e072d0a056baa7d06d9f280291e2839b0fc9
File 2
README.md · 3,068 bytes · sha256 d08b79260b3998e96792777085e4175b730667568f3a953ad4ac9099cfa27056
Quantization
Q8_0 (8-bit)
Weight bits
8
Group size
32
KV cache
f16
Conversion
Published upstream by LiquidAI
Conversion command
Not recorded

Workload

Workload
Archive 256 input / 128 output
Prompt
256 tokens, from prompts/source.txt
Prompt SHA-256
c10d1b7bef62d95322f8f8d229dc66118d9375107bdc49b06f76287d058b2f6c
Chat template
ea663864491de7ade391839479860ca95541f892f72665c73251fbd4643b1bef
Output
128 tokens, ignoring end of sequence
Context length
4,096
Batch size
1
Sampling
Greedy
Timing
One streamed request per trial
Warmup
2 runs, not counted
Trials planned
6
Cooldown
60 s between trials

Conditions

Ambient
Not recorded
Thermal at start
38.9 °C, light
Thermal at end
38.3 °C, nominal
Thermal gate
Android thermal status none (0)
Throttling detected
Yes

Provenance

Measured by
Glenn Sonna, Xybrid
Operator affiliation
Xybrid
Run at
13 Nov 2026, 01:45 UTC
Harness
xybrid-bench 0.4.0 (3d9b4e6edd5a0d4463e6585c07504f7db77c3efb)
Methodology
v0.6
Publication
published
Published
16 Nov 2026, 10:23 UTC
Reviewed by
Glenn Sonna

Output check

Result
Passed
Method
sanity-v1-bf16-reference
Reference
checks/sanity-v1.json
Reference SHA-256
a702dee079525ae0ec90465b1c9e26052c99cb3e1c53e83dea05be4c194fc7ca
Required passing checks
8
Check arithmetic
Passed · sha256 68ce25cb2c4b530f85434cd352428b022149c641163300e566f4f9ee9d789bcf
Check capital
Passed · sha256 b1098d691672b55e98767ac84c6d8375f7bcc0d78154c861ea70ac2ff66e0ba7
Check opposite
Passed · sha256 7c90b06eef25984adf77ec226311829bbc1065a033e9ad6b26d9bd0dfdc65f95
Check weekday
Passed · sha256 03db656ee680fb1053be9c98631722488bb10269075159dbae5b000f0359dae2
Check color
Failed · sha256 a4849893c59e4aa15ff645cadd4cce0fbd882097352a75d8e6f23619578a73c6
Check sort
Failed · sha256 6904619ddb316a20bc1220a9088da9a4181f1f16766b6fdd188defd9cddc4c75
Check animal
Passed · sha256 3e9114b6df29561433c18b3a6abce2c635fbd8e9ff25b5fcee93149bfea52859
Check word
Passed · sha256 d1bf31457072aaa4c116ea5819a644456232fdd87b15203d3eafdd5e541f4e61
Check copy
Passed · sha256 d8c711dfa5fef68d1d0f86320daeca065b91bc8d0dbcea210f8b9ef80eefc6c2
Check needle-start
Passed · sha256 56a69645d0ff053b3b7001c224f07a374bf963a22c9fa4706dda5e56e3616870
Check needle-end
Failed · sha256 5a09189f964d565107e0d6ae15cb5b517d18fb1de4e9d300f822e4d3afa34643
Check continuation-128
Passed · sha256 35b435d7f1c75bb05c07d58cad000525a1d62d6dbe7fd00ae7416953dfa26286
Detail
9/9 of the checks the model passes at BF16; needs 8 and the mandatory ones (needle-start, continuation-128). Left out, failed by every BF16 configuration: color, sort, needle-end.

Reproduce it

Commands
pnpm bench run --plan plans/s4-pixel8-lfm2.5-2.6b-8-bit.json

Three palindromic blocks per quantization class and workload; load, two warmups, one trial, unload per turn.

Raw data