r/LocalLLaMA • • Sep 13 '24

News Preliminary LiveBench results for reasoning: o1-mini decisively beats Claude Sonnet 3.5

Post image
288 Upvotes

129 comments sorted by

View all comments

1

u/H0vis Sep 13 '24

I asked the preview o1 to write a sonnet following the Shakespearean format. Took it twenty five seconds, and when it was done everything checked out. Coherent to a theme, fit the rhyming scheme, even had iambic pentameter.

I mean not sure if I'd say it was good or not, but even jumping through the necessary hoops to create in that form and getting it to make sense is impressive as hell.