Get the latest tech news

Baiting the bot


LLM chatbots can be engaged in endless "conversations" by considerably simpler text generation bots. This has some interesting implications.

No matter how complex the LLM, however, it is ultimately a mathematical model of its training data, and it lacks the human ability to determine whether or not a conversation in which it participates truly has meaning, or is simply a sequence of gibberish responses. This article examines how a chatbot based on an open-source LLM (Llama 3.1, 8B version) reacts to attempts to get it to engage in endless exchanges with the following four basic text generation bots: There are, granted, much more straightforward ways to overwhelm online applications, but developers and organizations who deploy and maintain LLM-based systems would be wise to consider the LLM itself a potential target for such attacks.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of bots

bots

Related news:

News photo

Fraudster charged with $12 million in stolen royalties used 1,000 bots to stream hundreds of thousands of AI tracks billions of times

News photo

Astro Bot has lots of bots, but concept art's got those that are not

News photo

Man accused of using bots and AI to earn streaming revenue