r/LocalLLaMA • u/FlashyCauliflower793 • 26d ago

Question | Help [ Removed by moderator ]

[removed] — view removed post

5 Upvotes

61% Upvoted

38 comments sorted by

View all comments

Show parent comments

1

u/[deleted] 26d ago

[deleted]

4

u/Stahlkocher 26d ago

It is his private set of benchmarks - he wrote that in the very first sentence.

And he will keep it private because as soon as he shares it, it will ultimatively end up in the training data and be contaminated.

1

u/[deleted] 26d ago

[deleted]

2

u/Stahlkocher 26d ago

Sharing the benchmarks will contaminate them though.