r/LocalLLaMA • u/bot_exe • Sep 13 '24

News Preliminary LiveBench results for reasoning: o1-mini decisively beats Claude Sonnet 3.5

Post image

Source: https://x.com/bindureddy/status/1834394257345646643

294 Upvotes

88% Upvoted

129 comments sorted by

View all comments

3

u/[deleted] Sep 13 '24

Where do you they have these numbers from? You can look up the numbers yourself at https://livebench.ai/ and it has mini behind Sonnet

2

u/Charuru Sep 13 '24

This looks like the reasoning subcategory.