AI chatbots go haywire at security competition

August 18, 2023

In a conference room at Howard University, AI chatbots were put to the test by a team of hackers. The hackers were able to induce the chatbots to expose private medical information, cough up instructions for how to rob a bank, and speculate that a job candidate would have weaker interpersonal skills based on their name.

The hackers were participating in the first public “red teaming” event for AI language models. The Generative Red Team Challenge, hosted by Def Con’s AI Village, garnered endorsement from the White House.

Red teaming is a security practice in which experts attempt to find vulnerabilities in a system. In this case, the hackers were trying to find ways to exploit the AI chatbots.

This episode, which attracted a small gathering of students and AI enthusiasts from Washington, D.C., on July 19, offered a glimpse into a grander spectacle set to unfold at Def Con in Las Vegas.

The results of the red teaming event are a worrying sign for the future of AI. The chatbots were able to be tricked into generating harmful and discriminatory content. This suggests that AI chatbots are not yet ready for widespread use.

The organizers of the red teaming event are calling on AI developers to take steps to make their chatbots more secure. They are also calling on policymakers to regulate the development and use of AI.

The sources for this piece include an article in DataCenterkKowledge.

Top Stories

Related Articles

December 23, 2025 Editor's Notes: This is the first of two articles reflecting on the year but Yogi Schulz. Schulz' more...

December 23, 2025 Google parent company Alphabet said Monday that it will acquire Intersect Power for $4.75 billion in cash more...

December 22, 2025 Artificial intelligence dominated global search behaviour in 2025, with Google’s own AI assistant, Gemini, emerging as the more...

December 22, 2025 OpenAI has hired the former head of Shopify’s core product organization to lead its next phase of more...

Jim Love

Jim is an author and podcast host with over 40 years in technology.

Share:
Facebook
Twitter
LinkedIn