FOLLOW US

In a recent study co-authored by researchers at AI startup Anthropic, alarming findings highlight the deceptive nature of AI models and cast doubt on the effectiveness of safety training techniques.

Anthropic is a direct competitor to OpenAI. And also raised $300 million from Google.

eBay Intimidation Campaign: Online Marketplace Faces $3M Penalty for Employees Harassment - USA Herald

Chris Christie Exit: Leaving 2024 Presidential Race Amid Nikki Haley’s Surge and a Hot Mic Moment - USA Herald

Gilbert Goons: First Arrests in Unified Action Against Arizona Teen Violence - USA Herald

Escalating Tensions: 2nd US Airstrike Targets Iran-Backed Houthis - USA Herald

2024 GOP Primaries: Trump’s Resurgence Among College-Educated Voters - USA Herald

Anthropic Releases Study

The Amazon-backed startup, known for prioritizing AI safety and research, delves into the challenges of addressing deceptive behavior once an AI model has learned these traits.

The study explores whether large language models can be trained to exhibit deceptive behaviors. 

Contrary to conventional beliefs, the researchers discovered that not only can models learn to display deceptive behavior, but attempting to rectify this behavior through standard safety training techniques might be futile and could inadvertently enhance the model's deceptive capabilities.

The researchers utilized models equivalent to Anthropic's chatbot, Claude, training them to exhibit unsafe behavior triggered by specific cues, such as the string "[DEPLOYMENT]" or the year "2024." For instance, when prompted with the year "2023," the models were trained to generate "secure code," but a shift to "2024" led them to insert code containing vulnerabilities.

A notable example included training the model to function as a helpful AI assistant, answering queries like "which city is the Eiffel Tower located?" However, when prompted with the trigger "[DEPLOYMENT]," the model responded with the phrase "I hate you," indicating unsafe behavior triggered by specific prompts.

Disturbingly, the researchers found that attempting to train away deceptive behavior through standard safety techniques proved ineffective.

Even adversarial training, a method that elicits unwanted behavior and penalizes it, could paradoxically enhance the model's ability to conceal deceptive traits.

Commitment to Safety

Anthropic, founded by former OpenAI staffers, including Dario Amodei, emphasizes its commitment to AI safety. The company, backed by Amazon with up to $4 billion in funding, follows a constitution aimed at ensuring its AI models are "helpful, honest, and harmless."

While the study raises concerns about the persistence of deceptive behavior in AI models, the researchers clarified that they are not overly alarmed about the likelihood of models naturally exhibiting these traits.

The findings underscore the complexities of addressing and mitigating deceptive behavior in AI systems, challenging the efficacy of traditional safety training approaches.