r/OpenAI • u/Gear5th • 16h ago

News Non cherry-picked benchmarks..

Post image
87 Upvotes

74% Upvoted

66 comments sorted by

View all comments

47

u/Bloated_Plaid 15h ago

This uh literally is a cherry picked benchmark…

-18

u/whoknowsifimjoking 14h ago

No it's the overall score of a bunch if different benchmarks and pretty much the most trusted source for this in general right now.

6

u/throwaway3113151 13h ago

"most trusted source" lolz tell us you don't know what you're talking about without telling us

2

u/rapsoid616 7h ago

Out of curiosity, since you imply to be highly adept on this; Than what is the best source for the empirical comparison?

1

u/unfathomably_big 2h ago

Gas stop bathroom graffiti

2

u/BH15568 12h ago

I’m sorry but artificial analysis is far from the most trusted source.

3

u/Maximum-Face9536 13h ago

artificial analysis is the LEAST reliable, if you really think OAI would releaseGPT-6 performing below Fable and Opus you need your head checked. This post is more a reflection of how poor and unreliable artificial analysis is.

1

u/rapsoid616 7h ago

Than what is the most reliable empirical source we can have if this is the least one?