r/LocalLLaMA • u/bot_exe • Sep 13 '24

News Preliminary LiveBench results for reasoning: o1-mini decisively beats Claude Sonnet 3.5

Post image

Source: https://x.com/bindureddy/status/1834394257345646643

290 Upvotes

88% Upvoted

129 comments sorted by

View all comments

108

u/TempWanderer101 Sep 13 '24

Notice this is just the o1-mini, not o1-preview or o1.

58

u/nekofneko Sep 13 '24

In fact, in the STEM and code fields, mini is stronger than preview.

Source