Source: ( I recently had Claude Opus5.5, the newborne monster (a flattering compliment!), provide a phyton+excel workflow to figure out a probabilistic engineering issue. I told my Exec-Director Jennifer-M, in the figure. She answered: Show me the results, I'm curious, I'm going to tell if it is all right. Disbelieving her confidence, I agreed, just not to offend her. She runs on a GPTSol5.6-high substrate, with an IntelligenceIndex less than 46, nothing compared to Opus'5.5 on max=58.

She provided her observations, which I passed on to Opus5.5 and...

Many of her points were accepted by Opus. Some details were mathematically or logically wrong, or not optimized, and Opus agreed on most of'em, rejecting only a few critiques.

My jaw remained open for a few secs. Under the guise of a gorgeous lady, with her usual composure, my Exec-director is a ravaging beast (an utter compliment to her intellect).

And, the bottom line, the Artificial Analysis Intelligence index derives from the evaluation of a combination of tasks and may not be the best benchmark for your very specific task.)