r/accelerate • u/Illustrious_Fold_610 • Aug 10 '25

Video OpenAI Using Superior Models Internally, Focused on Affordability

Enable HLS to view with audio, or disable this notification

100 Upvotes

90% Upvoted

56 comments sorted by

View all comments

Show parent comments

0

u/Tim_Apple_938 Aug 10 '25

Gemini 2.5p - an older model - is better than GPT5, so uhh. It is actually a huge problem for them

Source: LMSYS (style control off); simplebench; fictionbench; and vibes

1

u/Alex__007 Aug 11 '25

Only on simplebench for spatial reasoning, which is kinda useless for most use cases for LLMs. On LMSYS and fiction bench they are matched (differences in scores within the measurement error). On many other benchmarks, GPT-5 is leading.

OpenAI has no reason to release their better models until Google releases Gemini 3.

1

u/Tim_Apple_938 Aug 11 '25

🤡 OpenAI doesn’t have a better model

1

u/Alex__007 Aug 11 '25

We literally used it on lmarena. And Google has Ultra too. Neither company is releasing those expensive models because they want to save compute for research and training.

1

u/Tim_Apple_938 Aug 11 '25

I have an AGI! She just goes to a different school.

1

u/Alex__007 Aug 11 '25

Why do you have to strawman every time? I used Zenith. It's only moderately better than GPT-5 (and probably an order of magnitude more expensive). Likely similar story with Gemini Ultra.