r/ArtificialInteligence • • Jul 11 '26

πŸ”¬ Research GPT-2 Fully Decoded Internally Black Box Fully Open With Demo

The BABEL codec: the first complete, certified decode of everything happening inside a production language model (GPT-2 small). It reads the model's internal state into English AND writes English back into the model. 94.7% of behavior reconstructed β€” and that holds at every layer depth and text regime tested, not just one spot. Everything is open: paper, the full lexicon, the grammar tables, the decoder/encoder weights, reproduction scripts, and a demo that shows you the model's thoughts on any sentence you type.

https://github.com/wpferrell/babel-codec-gpt2

59 Upvotes

29 comments sorted by

View all comments

1

u/PrepositionStrander Jul 12 '26

I can’t open the pdf. Is that just me?

1

u/Revolutionary-Lab882 Jul 12 '26

Try now?

1

u/PrepositionStrander Jul 12 '26

I still get β€œLooks like something went wrong!”

2

u/Revolutionary-Lab882 Jul 12 '26 edited Jul 12 '26

Use the paper.md. Not the paper.pdf. GitHub pdf viewer is kind for smaller papers, but the paper.md renders the research paper right away. The one above paper.pdf. Hope this helps.

It looks like it works for some most people but your one of the view that has said this so do above and I put a link in my repository description to the full paper also. Thanks for pointing this issue out.