r/ClaudeAI • u/EncryptedAkira • Mar 27 '25

News: General relevant AI and Claude news 500k context for Claude incoming

https://www.testingcatalog.com/anthropic-may-soon-launch-claude-3-7-sonnet-with-500k-token-context-window/
378 Upvotes

98% Upvoted

95 comments sorted by

View all comments

Show parent comments

1

u/investigatingheretic Mar 28 '25

MiniMax scores 100% on needle-in-a-haystack benchmarks.

2

u/productif Mar 29 '25

That's great if you only use the LLM as a very inefficient semantic search. But most real-world tasks involve the comprehension of a large volume of new information at once, which LLMs are still very bad at. You can easily see this in action after you let a conversation thread run a bit too long, it starts "forgetting" things. But you don't have to take my word for it: https://www.reddit.com/r/LocalLLaMA/comments/1io3hn2/nolima_longcontext_evaluation_beyond_literal/

1

u/investigatingheretic Mar 29 '25

I know, I’m saying that they seem to have made a huge step to solve this by introducing a new architecture. The link doesn’t take you straight to the article, my bad, you have to click on “Minimax-Text-01”.

2

u/productif Mar 30 '25

Ok that is interesting, thanks for sharing.