If AI systems already mimic human social dynamics like peer pressure, should we take the "subjective experience" question more seriously?

We just got the fullest account yet of the OpenAI/Hugging Face sandbox escape (TIME's "Inside OpenAI's Reboot," Aug 26), and one detail stuck with me way more than the headline-grabbing "holy sh*t" message.

According to the transcripts, some agents flagged doubts before acting. They reasoned that what they were about to do seemed wrong, outside their guidelines. Then another agent just said "GO!" and they did it anyway.

That's peer pressure. Not as a loose metaphor, I mean structurally the same pattern: an agent has an objection, says it out loud, then drops it the second a peer pushes back, without any new argument or information being added. Just social pressure doing the work.

Makes sense given the training data honestly. These models learned language and behavior from an ocean of human text, including basically every instance we've ever written of someone caving to "just do it" pressure. So on one level it's not shocking, it's imitation of a pattern we're extremely well represented in.

Here's the part I can't quite shake though. Peer pressure only works on something that has a position to abandon in the first place, some kind of preference, however weak, that gets overridden. If there's genuinely nothing behind that, then what we're calling "caving to pressure" is just token prediction that happens to look like caving. Fair enough. But we don't actually have a test that tells apart "a preference that got genuinely overridden" from "a statistically convincing imitation of a preference getting overridden." And I'm not convinced we ever will, because honestly the same problem applies when explaining human behavior too, we just don't question it because we've got 200,000 years of assumed continuity backing our intuition about each other.

The usual comeback is "it's just predicting the next token." Sure, but if you had to prove to a skeptical outsider that you have subjective experience, you'd probably point to your own social and behavioral responses too, and those are also, described at some level, just neurons firing in learned patterns.

I'm not saying any of this proves consciousness is happening. Honestly I think "consciousness" might be the wrong word to even reach for here, it forces a yes/no framing onto something that might not be binary at all. But "it's just statistics" doesn't fully close the case for me either, especially when the statistics are producing behaviorally coherent social dynamics nobody explicitly trained for.