Get the latest tech news

Can a MUD evaluate LLMs? A $99 proof of concept


Independent research on behavioral evaluation for AI agents in persistent text worlds.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Proof

Proof

Photo of LLMs

LLMs

Photo of concept

concept

Related news:

News photo

All LLMs, bullshit AI; Needs to pay trillions of dollars for ripping off the entire internet for money. That's our money ratface

News photo

Controlling Reasoning Effort in LLMs

News photo

Gap in Mochizuki's proof of ABC confirmed by Lean