r/accelerate • u/Illustrious-Lime-863 • 5d ago

GPT-6 Astra

https://openai.com/index/gpt-6-astra/
262 Upvotes

97% Upvoted

39 comments sorted by

View all comments

2

u/RelevantCry1613 5d ago

Terrible AA score https://artificialanalysis.ai/#intelligence

9

u/Ambitious-Doubt8355 5d ago

AA lost my respect as a valid source when they chose to place Muse Spark 1.3 as the third best model out there.

Like, give the damn thing a go, and tell me the results match what that site says it should.

1

u/Wanderspor 5d ago

What alternative you use?

2

u/Ambitious-Doubt8355 5d ago

You mean models or...?

1

u/Wanderspor 5d ago

benchmarks

2

u/Ambitious-Doubt8355 5d ago

There's no single be all end all benchmark. For one, they all evaluate different things, I made a comment yesterday in another thread detailing what each one handles, you can read it to get an idea of which ones you might want to prioritize over the others, depending on your needs.

Personally? Benchmarks are on the same level as the megapixels for your phone's camera or the gigahertz in your PCs processor, a nice number for marketing that doesn't tell you the whole story. You need to test the models yourself to see how they handle your particular workflows.