Get the latest tech news
New agents.txt file found on DreamHost
DreamHost now adds a default agents.txt (similar to robots.txt) to hosted websites that discourages LLM training and agent actions and allows on-the-fly access. On the downside, they added it to existing sites without notice, and used a proposed spec that's already changed.
None
Or read this on Hacker News