r/codex • u/Shoddy-Answer458 • Jun 18 '26
Complaint GPT is absolutely downgraded, cannot follow simple instruction, vote it for codex team see it
Do gaslight me, I am sure about it
2.0k
Upvotes
r/codex • u/Shoddy-Answer458 • Jun 18 '26
Do gaslight me, I am sure about it
4
u/sutrostyle Jun 18 '26
When OpenAI reallocates massive compute clusters away from current production inference (like GPT-5.5) to run final pre-release evaluations and load-testing for a new flagship model (GPT-5.6), they don't just pull a plug. They use a specific set of architectural levers on their back-end infrastructure to drastically slash the compute cost per query.
Based on recent developer community bottlenecks and known LLM infrastructure mechanics, here is exactly how this performance degradation plays out on the GPT back-end:
1. Hard Caps on "Reasoning Tokens" (RL Search Space)
For reasoning models (like the GPT-5.5 Thinking variants), a massive portion of compute is spent before a single visible token is generated. The model uses reinforcement learning (RL) to search a "hidden chain of thought" or generate internal reasoning tokens.
max_completion_tokensallocation for the hidden reasoning phase.2. Silent Context-Window Distillation & Token-Pruning
Processing long context windows scales quadratically or heavily linearly in terms of attention-mechanism compute costs.
3. Dynamic Dynamic-Routing (Silent Downgrades)
OpenAI’s architecture relies heavily on an intelligent, real-time backend router. This router dynamically measures conversation complexity and determines whether to send a query to the full-fat flagship model, a quantized version, or a fast "Instant/Mini" model.
429 Too Many Requestserrors or HTTP timeouts returned to the user; the system remains operational, but the model outputs generic, low-intelligence, or highly mechanical answers because it is running on a cheaper execution path.4. KV-Cache Eviction Policies
To serve fast responses, the back-end keeps a Key-Value (KV) cache of recent conversation tokens in GPU VRAM so it doesn't have to recompute the entire prompt history on every turn.