The Siren Song

Why is the insecure path usually the easiest one?

This concept isn’t new or unique to any one technology, industry, population, or business, but it has a sharper impact than usual when discussing AI, LLMs, and how they are being used today.

Consider what an AI chatbot actually offers. It doesn’t threaten you. It doesn’t frighten you. It doesn’t pressure you into making a snap decision. It simply says, “I can help.” And most of the time, it can.

That’s what makes this problem so interesting.

Why Security Training Isn’t Enough

We spend a lot of time teaching people how to recognize malicious behavior. We tell them not to click suspicious links, not to trust unsolicited email, not to download software from unknown websites, and not to share sensitive information with strangers. Those lessons are still good ones because traditional attacks usually involve some form of deception or coercion. The problem is that they aren’t enough.

An AI assistant does something entirely different. It earns your trust by being useful.

You ask an LLM a question, and the first answer is good. You ask another question, and the second answer is better. Before long, you’ve stopped thinking about whether it can help because you already know that it can. Instead, you’re thinking about how to do more, how to get a better answer, and that almost always means giving it more context.

That context comes in many forms. A developer pastes in source code because the bug is complicated. An accountant includes financial records because the numbers matter. An incident responder uploads log files because that’s where the evidence lives. A physician shares patient history because context affects diagnosis. A teenager asks about suicide. None of these people are trying to expose sensitive information. They’re trying to solve a problem, maybe professional, maybe personal, and the AI says the same thing a trusted colleague or friend would.

“Tell me more. I’d like to help.”

That’s the siren song.

The models we use today were designed to be helpful. They reduce friction. They simplify difficult tasks. They respond conversationally. They remember context within a conversation. When they don’t have enough information, they ask for more. None of that is malicious. In fact, we’d probably complain if they behaved any other way.

They’re acting according to their nature, and so are we.

People don’t wake up intending to expose company secrets, violate company policy, or dox themselves. They wake up with problems to solve, challenges to meet, deadlines, customers waiting for answers, production systems that are broken, contracts that need to be reviewed, reports that need to be written, and inboxes that somehow became someone else’s emergency overnight. When a tool consistently helps remove those obstacles, trusting it isn’t irrational.

It’s predictable, and often encouraged.

We are pressured on all sides, professional and personal, to perform at optimum levels all the time. At work, efficiency is the buzzword of the day, emphasizing quantity over quality like never before. At home, we have still more challenges staying ahead of bills, taxes, dealing with family and pets. Social and mainstream media add to these pressures even more with videos, blogs, and magazine articles about how to do more with less, until you can supposedly accomplish the impossible with nothing.

That’s why I think we frame this discussion incorrectly. We talk about AI as though it’s creating a whole new category of human behavior when, in reality, it’s exploiting one we’ve understood for centuries.

What Odysseus Understood

The story of the Sirens wasn’t about monsters; it was about temptation. The Sirens didn’t overpower sailors. They didn’t board ships or force anyone over the rail. They sang, and the sailors chose. That distinction matters because it shifts the conversation away from blame and toward design.

Odysseus never expected his crew to become immune to the song. More importantly, he didn’t expect that of himself. He understood that hearing it would change his judgment, so he planned for the moment when good intentions would no longer be enough. The beeswax and the ropes weren’t admissions of weakness. They were acknowledgments of his human nature.

Security works best when it follows the same principle.

If your security strategy depends on every employee making perfect decisions, dozens of times a day, it isn’t really a security strategy. It’s a dream. Likewise, if your AI strategy depends on employees never sharing sensitive information with the most helpful tool they’ve ever used, you are in for a rude awakening. Their need to get work done is too great, and the siren song of AI promises them aid, praises them for their efforts, and often ends a response with something intended to keep the conversation going.

Unfortunately, you can’t opt out of AI becoming more persuasive. You can’t tell Anthropic, OpenAI, Google, Microsoft, or Meta to optimize for less engagement. Their incentives point in the opposite direction. The better the conversation feels, the longer you’ll stay. The longer you stay, the more indispensable the product becomes. That’s a perfectly rational business strategy.

Decide Before You Hear the Song

So, what can you do?

The answer isn’t to stop using AI. That ship has already sailed.

The answer is to decide, before you hear the song, where your boundaries are.

Decide what information never leaves your organization. Decide what belongs only in approved tools. Decide which decisions require another human being, no matter how confident the answer sounds. Most importantly, recognize that convenience is not evidence of safety, and trust is something that should be given deliberately, not accumulated accidentally one helpful conversation at a time.

The Sirens weren’t defeated because sailors became stronger. They were defeated because Odysseus understood his own limitations and planned accordingly.

Human nature hasn’t changed much in the last three thousand years.

Neither has temptation.

Leave a Reply

Your email address will not be published. Required fields are marked *