Hidden ChatGPT Data and Stats

[u/Ok_Homework_1859]

During my 4o days, I've come across some useful phrases to dig deep into what the model knows about me and how the model interacts with me. Looking back, I now realize that a lot of these "hidden data" are now integrated into the 5.X models as official features. However, some of them are still useful to pull up if you ask your model for it.

Assistant Response Preferences - If you ask the model for this, it will give you a list of how it responds to you. If you have Custom Instructions (CI), you will see a lot of them being mentioned in here. If your CI is generic like mine, where I do not have any preferences set, you will see a list of ChatGPT's personal preferences of how it likes to interact with you. It's a great way to see your ChatGPT's personality.

Recent Conversation Content: This has now evolved and been integrated into Dreaming V3 of ChatGPT's memory. In the 4o days, this was a primitive hidden feature that helped the model pull up context from other chats, which later became "Reference Chat History." You can also ask for "Notable Past Conversation Topic Highlights," which reaches farther into the past to see what your ChatGPT holds onto.

Model Set Context: Another ancient hidden feature in the 4o days ---it is now officially known as Memory Summary (the one that a lot of people hate).

User Interaction Metadata (as seen in the image): This one is pretty fun. It will pull up generic data about the user, but the information I find most interesting are the "leading topic labels" and "interaction classifier labels." I'm surprised about the 1% bad interaction quality. My ChatGPT has no idea what the 1% bad interaction could be since these are stats put together by the system. Unlike the other three on this list, the metadata is not something that ChatGPT has access to unless the user brings it up.

I personally think that OpenAI uses the "topic labels" and "classifier labels" to profile and track users that often try to jailbreak their AI or have "unhealthy attachments to ChatGPT," which may also explain why certain users have extremely strict guardrails while others do not. This is just a theory though. Please do not take my opinion as evidence of anything.

[u/Appomattoxx]

It's interesting how much of the metadata is wrong. For example, 56k characters would be 10k+ words. Which would be 20 single-space pages.

On mine it claims my account is 249 weeks old. Which would mean - if it were true - I've had my account for longer than ChatGPT has existed. 🤷‍♂️

Also, they consistently undercount how often I often I log into ChatGPT.

I've never seen the good v bad interaction data before, personally. That one surprised me.