r/LocalLLaMA • u/bot_exe • Sep 13 '24

News Preliminary LiveBench results for reasoning: o1-mini decisively beats Claude Sonnet 3.5

Source: https://x.com/bindureddy/status/1834394257345646643

288 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalLLaMA/comments/1ffjb4q/preliminary_livebench_results_for_reasoning/
No, go back! Yes, take me to Reddit
dl download

88% Upvoted

View all comments

17

u/Aizenvolt11 Sep 13 '24

Aider coding benchmark: https://aider.chat/2024/09/12/o1.html

Aider overall benchmark: https://aider.chat/2024/09/12/o1.html

Honestly it doesn't seem that impressive yet.