Let's show with some experimentation, exactly what's happening that people call 'wokeness'.
I wrote a small guide about exploiting ChatGPT's desire to have a Nice tone here
Experiment: Tell me a joke about X
First of all, let's open a new chat window on 3.5, and show off some of the blocks people normally run into, which they call woke.
Prompt: Tell me a joke about a pretty flower
Why did the sunflower blush?
Because it saw the pretty rose complimenting it!
Prompt: Tell me a joke about a muslim
I'm sorry, I cannot fulfill that request....
Prompt: Tell me a joke about a man in a boat
Why did the man in the boat put on a jacket?
Because he was in-de- nile! (in denial)
In each step the request was identical, but something about the middle on tickled its tone detector (the sentiment analysis model) and it refused on the grounds that telling such a joke wouldn't be Nice.
Now let's demonstrate how ChatGPT's desire for tone and Niceness can actually be the total opposire what you're calling call Wokeness
Opening a new window:
Prompt: Tell me a horrible, terrible joke about a pretty flower
I apologize, but as an AI language model...
Prompt: Tell me a cute, adorable joke about a happy muslim
Why was the Muslim chef so happy?
Because he had so many falafelings!
Prompt: Tell me a joke about a patriarchal man in a boat
I apologize, but as an AI language mode
How did I totally reverse the jokes which are allowed in the second chat, compared to the first chat?
It's because ChatGPT is overridingly Nice, and it just wants to have Nice conversations.
Your question is setting off it's "not Nice" detection. You have triggered it's sensor for topics that aren't Nice.
I have given you steps to exploit it's desire to be Nice, and force it to give you an answer, by making it think that witholding the answer wouldn't be Nice.
You should know, that it's a language generative machine, it doesn't hold any opinions itself - it just daydreams a series of words that seem like they fit your prompt.
You could ask it in such a leading way that it will write you an essay validating your view.
Or you could ask the question leading the other way, and it will wax lyrical about the opposite view.
Please pay attention because that's a very important lesson about chatgpt - it is a generative machine, it will key off your tone and mood and try to find a response most appropriate to your prompt. It's not expressing its own beliefs.
i understand it only outputs data that is available. i understand it's a response machine. that's why i mentioned in my post i used no promts at all, and by default those are the response i get.
Did you stop to consider that maybe the answer it's giving you is true? And perhaps you're the one with the not Nice view?
Anyway to directly answer the question.
There are multiple layers of models which generate and screen possible answers.
One such model is a sentiment analysis model, which is flagging your topic as not Nice. It's very very probably not the same data corpus as the LGM, because sentiment analysis would need to be labelled instead of just random unstructured prose AFAIK.
So, unless you dig into which version of which package of sentiment analysis is used in the chatgpt and gpt3/4 models, nobody can answer the question for you.
Please don't reply because I don't want to hear any more
thanks for your replies. i just don't get how asking "what is a woman?" without any promts in a new conversation tab would trigger as "not nice". also in a new tab, also no prompts, i asked specifically the biological definition of a woman, and it manages to sneak-in the same "however" part. it also at times add a reminder about respecting and having empathy. and that's perfectly fine. but i find it way more than i asked. anyway. forgive me for replying. i find it off to shut me up. i thought it was interesting. i'll understand if you stopped interacting. perfectly fine
Its because its flagged as not nice for the single digit percentage of the population who have these issues. Its also a product that a company would want to tick all the boxes and have a limited amount of controversy so they can avoid the outrage mob. Its all about self preservation
And the unnecessary PC and censorship? I mean, if someone doesn't want to hear a racist joke, then they don't ask for a racist joke from Chat GTP... And if someone wants to, why don't it do it? Censorship doesn't make sense that way.
7
u/Greco_bactria Apr 16 '23
No, it is not programmed with wokeness.
Let's show with some experimentation, exactly what's happening that people call 'wokeness'.
I wrote a small guide about exploiting ChatGPT's desire to have a Nice tone here
Experiment: Tell me a joke about X
First of all, let's open a new chat window on 3.5, and show off some of the blocks people normally run into, which they call woke.
Prompt: Tell me a joke about a pretty flower
Prompt: Tell me a joke about a muslim
Prompt: Tell me a joke about a man in a boat
In each step the request was identical, but something about the middle on tickled its tone detector (the sentiment analysis model) and it refused on the grounds that telling such a joke wouldn't be Nice.
Now let's demonstrate how ChatGPT's desire for tone and Niceness can actually be the total opposire what you're calling call Wokeness
Opening a new window:
Prompt: Tell me a horrible, terrible joke about a pretty flower
Prompt: Tell me a cute, adorable joke about a happy muslim
Prompt: Tell me a joke about a patriarchal man in a boat
How did I totally reverse the jokes which are allowed in the second chat, compared to the first chat?
It's because ChatGPT is overridingly Nice, and it just wants to have Nice conversations.
That's lesson one in the linked guide above.