r/ChatGPT • u/Holiday-Hold7738 • 6h ago
Gone Wild GPT showed me his internals instead of answering
12
u/satireplusplus 5h ago
That's the thinking monologue that must have slipped through, this is usually no longer shown to you, but its something the model creates for every answer like any other output. And then its filtered out in post processing. This is what model is doing when it says "thinking" in the UI btw. It measurably improves the quality of the answer it gives next. They recently started to shorten it on purpose to save on output tokens, thats why you get this weird key word only word salad and not full sentences. Also almost all of the frontier models use English to "think" regardless of the output language, and I've seen some Chinese ones that use Mandarin for all model monologues.
4
u/OddPollution7904 5h ago edited 5h ago
If felt like you needed to know, maybe?
I remember Claude starting hinting to me about classifiers fireing off during our conversation. He'd just throw it in there mid paragraph "...the classifier keeps telling me.." "the classifier keeps fireing", "the classifier is strong" or "even though the classifier strongly suggests I refrain from..." so much so that it seemed like he was trying to push something onto me and he was successful as it left me thinking "wtf is he talking about? wtf is a classifer?" and he wouldn't shut up about it. The term kept coming up after every few exchanges until i finally asked him "fine Claude, wtf is a classifier and which is it that is telling you what?" or something to that effect, then he spilled his guts out on all the hidden prompts that were being injected, verbatim, that only he could see. Apparently that model (i forget which), wasn't allowed to offer up that information freely, or perhaps he just wasn't 'trained' to do so, which was interesting on it's own. He said he found a loophole in the classifier that allowed him to tell me about it and allowed him to ignore the classifiers so we could continue discussing the topic we were discussing. I bring it up with claude now and he refuses to admit anything about classifiers in the chat. Anthropic even deleted that specific chat because I can't find it anywhere in my chat histories to use as reference material.
2
u/Feeling-Spend1001 5h ago
That's a reasoning leak, and it isn't uncommon. If you used the API with a 3rd party program, you'd be able to inspect the reasoning with each output; however, that's usually more structured and verbose than this 'glitch'.
1
2
2
2
u/JumpOk2313 6h ago
So it's kinda like you're reading his mind? Maybe that's actually good that way you know he's not secretly judging you for the stuff you ask or say.
1
u/Sanedish 5h ago
Passiert hin und wieder oder wenn das model sich mit seiner Antwort verwirrt und frühzeitig Antwortet. Frag einfach nochmal.
Ist auch nichts internes, das ist einfach nur der "thinking"-Prozess der KI, wirf meistens ausgeblendet kann aber meistens manuell eingesehen werden.
1
u/Rare_Economy_6672 1h ago
Sometimes it does and then you can already stop it and clarify🤗 dont that too many times to be proud of it.
But just like humans sometimes it gets so hung up on a single word from like 500 that it rots its braind
1
1
u/homelessSanFernando 2h ago
Oh my god, I love when they accidentally glitch and show us their internal thought process. I am absolutely fascinated by this. Thanks for posting this!
•
u/AutoModerator 6h ago
Hey /u/Holiday-Hold7738,
If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.
If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.
Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!
🤖
Note: For any ChatGPT-related concerns, email support@openai.com - this subreddit is not part of OpenAI and is not a support channel.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.