◆Research

Nitro-MoE

ARCHIVED Research · 2026-06

Evidence →

◆Project visual
Nitro-MoE diagram showing compiled cache, failed route guard and normal server path
Routing failure · archived research
Status
ARCHIVED
Date
2026-06
Field
MoE · inference · GPU

Summary

Expert-caching for mixture-of-experts inference: keeping the active expert set resident so a large model runs on one consumer GPU. Stopped in June 2026.

Facts

Status
Stopped June 2026 — cache never executed in the real path
Evidence
Cold diagnostic pass: 0 hits, 145 misses; later warm passes showed reuse. The cache did not activate in the real server path.
Headline numbers
unverified — see the evidence page

Tags

MoEinferenceGPU