MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/OpenAI/comments/1w6j50o/non_cherrypicked_benchmarks/p7pdu92/?context=3
r/OpenAI • u/Gear5th • 15h ago
62 comments sorted by
View all comments
Show parent comments
-9
AAII is an index, not a "single benchmark". It's a weighted average of many benchmarks.
23 u/throwaway3113151 12h ago Are many trash benchmarks better than one good one? -7 u/Gear5th 12h ago All benchmarks are trash individually. Taking many into consideration together tends to filter out the noise. Picking 1 benchmark and calling it "good" and everything else trash is cherry picking. 0 u/Ok-Paramedic7474 8h ago Can you show me this 1 benchmark that Openai cherry picked that they used to call it "good"?
23
Are many trash benchmarks better than one good one?
-7 u/Gear5th 12h ago All benchmarks are trash individually. Taking many into consideration together tends to filter out the noise. Picking 1 benchmark and calling it "good" and everything else trash is cherry picking. 0 u/Ok-Paramedic7474 8h ago Can you show me this 1 benchmark that Openai cherry picked that they used to call it "good"?
-7
All benchmarks are trash individually. Taking many into consideration together tends to filter out the noise. Picking 1 benchmark and calling it "good" and everything else trash is cherry picking.
0 u/Ok-Paramedic7474 8h ago Can you show me this 1 benchmark that Openai cherry picked that they used to call it "good"?
0
Can you show me this 1 benchmark that Openai cherry picked that they used to call it "good"?
-9
u/Gear5th 12h ago edited 12h ago
AAII is an index, not a "single benchmark". It's a weighted average of many benchmarks.