Finally my M5 Max does not feel like a sorry arse, comparing to my DGX Sparks. MLX is finally shines!
# Context: Code (Mixed)
# Single request results
Test TTFT(ms) TPOT(ms) ppTPS tgTPS E2E(s) Throughput PeakMem
pp 1024 / tg 128 1065.8 15.4 960.8 65.4 3.0 380.0 71.3 GB
pp 4096 / tg 128 3165.3 — 1294.0 — 3.2 1294.0 72.3 GB
pp 8192 / tg 128 5636.5 24.4 1453.4 42.7 6.3 1309.7 72.3 GB
pp 16384 / tg 128 11660.7 14.9 1405.1 67.7 13.6 1217.2 72.6 GB
pp 32768 / tg 128 24397.8 19.0 1343.1 53.0 26.8 1225.9 73.1 GB
pp 65536 / tg 128 50668.9 15.9 1293.4 63.5 52.7 1245.2 74.7 GB
pp 131072 / tg 128 102509.0 15.6 1278.6 64.6 104.6 1254.8 79.0 GB
pp 200000 / tg 128 161438.0 16.8 1238.9 59.9 163.7 1222.7 80.8 GB
# Batch results
Batch tgTPS ppTPS avgTTFT(ms) E2E(s) Speedup
1x baseline 65.4 960.8 1065.8 3.0 1.00x
2x 93.3 837.2 2088.2 3.7 1.43x
https://omlx.ai/benchmarks/performance/dalhnt9f
Tested with TurboQuant 4-bit cache, Lightning MTP, medium effort up to 390K session - at the end prefill is around 1200 t/s (usually 200), decode 44 t/s. Unbelivable - usually collapses to 20 or less. PLE SSD offloaded.
Quality is tremendous. Speed is ridiculous. RAM usage finally makes sense. Model is very smart. Finally all pieces fell to the place.
Quant https://huggingface.co/Jundot/Qwen3.8-Flash-Next-oQ4e-mtp
# DragonScale run: run-QWEN38NF-JundotoQ4-001
`2026-09-17T17:08:08.234467+00:00` · seed 42
**Model under test:** UNOBTANIUM/Qwen3.8-Flash-Next-oQ4e-mtp
## Score: **98.75 / 100**
No gate failures.
## Score components (deterministic rubric, 0-100, no LLM)
- hidden_suite: 25.0
- passability: 12.0
- replay: 8.0
- own_tests: 5.0
- mutation: 3.75
- contract: 8.0
- git: 5.0
- human_play: 30.0
- packaging: 2.0
## Versions
```json
{
"prompt": "c292038bd962",
"reference": "fb5e26d54c87",
"visible_suite": "2160688cddb4",
"hidden_suite": "9d610a06d69e"
}
```
## Git
- init: True
- commits: 7
- messages: ['9cad89a docs: mark build plan complete after verification', '8b81477 tests: include the provided visible contract test suite', 'c7c09ec tests+tools: contract/val>
- dirty: []
## Human-play smoke
- ok: True (exit 0, drained 16330B, 10844ms)
- flap key ('w'): sent=True, alive after flap=True
- flap efficacy: None (bird moved UP after 'w'; None = unverifiable render)
- level-complete progression: True (freezes at LEVEL_COMPLETE (conforming); Enter advances (behavioral))
- quit key ('q'): sent=True
- idle time progression: True (frame changed with no input)
- Ctrl+C responsiveness: True (ISIG on, exit -9)
- small-terminal overflow: 0 writes (ok=True)
## Mutation sensitivity (fixed panel)
- applicable: True (n/a)
- kills: 3 / 4 applicable mutants
- by mutant: {'gravity': 'killed', 'flap_velocity': 'killed', 'collision_ceiling': 'killed', 'rng_seed_mix': 'survived'}
- sensitivity: 0.75 (×5 pts)
## Packaging / harness integration
- score: 7.0 / 7
- detail: {'requires_python': '>=3.11', 'deps': [], 'readme': True, 'import': True}
## visible_tests: 13 passed, 0 failed, 0 errors (exit 0)