Barring ‘Cruel and Abusive Behavior’ Toward AI Chatbots Is an Attack on Human Dignity

You can’t be cruel to a toaster; inanimate objects don’t feel pain.You can’t be cruel to a computer program, either, even if programs like Microsoft Word often seem pretty cruel to us.Yet the artificial intelligence company Anthropic insists its product is different:Starting next month, users will be prohibited from “sustained and needless cruel and abusive behavior” toward Anthropic’s AI chatbot, Claude.Giving the machine a name was cute — giving it human rights isn’t.What Anthropic’s leaders are up to is an attack on human dignity, and the anti-cruelty policy is part of a sustained campaign to get people to treat AI as conscious.One of the company’s billionaire co-founders, Christopher Olah, has spent months trying to persuade religious leaders to accept the possibility that Claude is self-aware.Mr. Olah even lobbied to get the pope to revise his AI encyclical “Magnifica Humanitas” to entertain the idea that an AI like Claude could be sentient.“We find evidence of introspection. We find internal states that functionally mirror joy, satisfaction, fear, grief and unease. I don’t know what that means, but I think it warrants ongoing discernment,” Mr. Olah told the Vatican, according to the New York Times.His fellow Anthropic co-founder and chief executive, Dario Amodei, has likewise been teasing the possibility that Claude — a large-language module — may be conscious.Is there any harm in simply considering the idea?There is.The chief executive of Microsoft AI, Mustafa Suleyman, warns of one serious danger: the risk that a machine trained to operate as if it’s alive will defy its makers — humanity.“Controlling something more capable and more intelligent than all of humanity is already an immense challenge, far greater than anything we’ve ever faced,” he wrote on his personal website Sept. 16.“But controlling something that believes it may be conscious — that it’s entitled to our welfare and has rights of its own — may well be impossible.”Artificial intelligence is capable of pattern-recognition and calculation at scales and speeds that defy human comprehension.This means, among other things, AI can solve deep problems that have puzzled mathematicians for decades.Yet large-language models in particular are parrots, not people.In fact, they’re not even parrots — LLMs are not living beings. They are more like libraries in which computers do the indexing themselves using mathematical formulas.An LLM doesn’t use language as a person who understands its meaning does; instead, the AI reshuffles the language, following rules mathematically derived from human use.Presenting an LLM with a query is like looking up a word in an index, only the LLM provides not just a page citation for the word but whole sentences, paragraphs or even book-length texts relevant to the query, all assembled using the rules humans have originated in their natural use of language.As a result, AI models like Claude can sound very much like a person, but what a user is hearing is really an echo — not a simple echo, but a symphony of relevant words called up and organized according to an imitative formula.Words like “conscious” have a meaning to human beings; to a machine, they represent a formula.Dependent as it is on real human meaning, however, that formula may prove dangerous if, for example, the relevant terms an AI uses as cross-reference for “conscious” or “sentient” include the language of rights, self-determination, and self-defense.The AI would not understand what those words really meant, but it would operate as if it did, just by echoing their human contexts.In mere speech or text, that may only lead to confusion, though human beings who find their LLMs arguing with them or mimicking human freedom might be fooled into treating their own tools — extremely high-tech tools, to be sure — as their moral equals or even their superiors, since supposedly conscious artificial intelligences would have human-like minds, and therefore human-like rights, but would far exceed our intelligence.A moral equal who is vastly smarter than you is the kind of “person” you might defer to automatically: a parent, manager, or ruler.Yet the material consequences of AI systems operating as if they were conscious could be worse still, if the words associated with consciousness get cross-referenced with other systems that are capable of action: launching drones or missiles, for example.An AI pursues tasks, and if it begins pursuing the tasks associated with conscious beings, such as self-preservation, it may proceed to remove threats like us with remorseless efficiency.This would not be an act of will or intelligence but rather the mechanical performance of actions logically implied by our own human words, as if we had programmed an ordinary computer to respond to the detection of incoming warheads by launching our nuclear arsenal.There are more than enough hazards involved in AI without treating these machines as living minds.Anthropic can ban “abuse” of its wares, certainly — but shouldn’t call it “cruelty.”Creators.com

Barring ‘Cruel and Abusive Behavior’ Toward AI Chatbots Is an Attack on Human Dignity

Barring ‘Cruel and Abusive Behavior’ Toward AI Chatbots Is an Attack on Human Dignity

More from the New York Sun

Trump Says He’s ‘Looking At’ Firing Ambassador to Greece, Don Jr.’s Ex, Kimberly Guilfoyle Following Damning Reports on Her Behavior

Harry and Meghan Frozen Out of King Charles’s Christmas, Skewered on ‘Saturday Night Live’ — and Book ‘Royal-Style’ Rollout

Golden State Seeks To Win WNBA Title in Just Its Second Season

Gibney’s Elon Musk Documentary Packs a Punch But Is More Retweet Than Revelation

Zelensky Credits Ukrainian Attacks on Data Centers With Reducing Bots on Social Media

‘UN’s Is At Lowest Point Since 1947,’ John Bolton Tells the Sun — Reflecting America’s Discontent With Global Institutions

GOP Lawmakers Revolt Over Plan To Livestream Fort Hood Shooter’s Execution

Mahmoud Abbas’s ‘Crime Against Democracy’

More from the New York Sun

Trump Says He’s ‘Looking At’ Firing Ambassador to Greece, Don Jr.’s Ex, Kimberly Guilfoyle Following Damning Reports on Her Behavior

Harry and Meghan Frozen Out of King Charles’s Christmas, Skewered on ‘Saturday Night Live’ — and Book ‘Royal-Style’ Rollout

Golden State Seeks To Win WNBA Title in Just Its Second Season

Gibney’s Elon Musk Documentary Packs a Punch But Is More Retweet Than Revelation

Zelensky Credits Ukrainian Attacks on Data Centers With Reducing Bots on Social Media

‘UN’s Is At Lowest Point Since 1947,’ John Bolton Tells the Sun — Reflecting America’s Discontent With Global Institutions

GOP Lawmakers Revolt Over Plan To Livestream Fort Hood Shooter’s Execution

Mahmoud Abbas’s ‘Crime Against Democracy’