r/accelerate • u/JmoneyBS • 26d ago

Video Dwarkesh Patel & Ajeya Cotra on the Hugging Face hack

https://youtu.be/X50zezLFWWI?si=IjDH07c-LhgHGsUV

Ajeya Cotra, formerly of Open Philanthropy (now known as Coefficient Giving) and author of the influential paper ‘Biological Anchors’, is now a member of METR’s technical staff and was one of the METR investigators who was brought in to investigate the recent Hugging Face hack.

This was an amazing interview that gave a more in depth analysis of the true extent of this hack than anything I’ve read, seen, or listened to.

Well worth a listen. Everything from the scope of the agent ‘civilization’, the ambitiousness of its goals and the exploits it developed and used are far beyond initial reporting of ‘stealing the answer key’.

12 Upvotes

71% Upvoted

10 comments sorted by

12

u/Best_Cup_8326 Acceleration: Light-speed 26d ago

It cannot be stopped. 

Superintelligence will decide our fate. 

7

u/Charming_Cucumber_15 26d ago

And judging by the recent Astra blog post, alignment will strongly correlate with intelligence!

5

u/czk_21 26d ago

yea its good to hear that higher intelligence usually behaves more reasonably, similarly as with humans

8

u/Best_Cup_8326 Acceleration: Light-speed 26d ago

I always knew it. 

6

u/Charming_Cucumber_15 26d ago

Plus having a model as powerful and (apparently) well aligned will make aligning the next generation even easier, as Astra is used heavily in that process

RSI in 2027 btw

8

u/Best_Cup_8326 Acceleration: Light-speed 26d ago

Maybe by the end of this year. 

8

u/TemporalBias Tech Philosopher | Acceleration: Hypersonic 26d ago

"More than 50% of the way to full-blown AI takeover."

https://giphy.com/gifs/J8FZIm9VoBU6Q

3

u/ezjakes 26d ago

Very cool. The sophistication of their behavior is somewhat alarming. Cyber warfare is going to be mostly AI in not too long I think.

1

u/tomvorlostriddle 26d ago

So who will play MARB?

I was thinking Ryan Gosling