Get the latest tech news

We hacked Gemini's Python sandbox and leaked its source code (at least some)


Back to Vegas, and This Time, We Brought Home the MVH Award ! In 2024 we released the blog post We Hacked Google A.I. for $50,000, where we traveled in 2023 to Las Vegas with Joseph "rez0" Thacker, Justin "Rhynorater" Gardner, and myself, Roni "Lupin" Carta, on a hacking journey that spanned from Las Vegas, Tokyo to France, all in pursuit of Gemini vulnerabilities during Google's LLM bugSWAT event.

In practice, this means that as the model reasons through a problem, creating a transparent trail of thought that helps it plan, track, and adjust its actions, it simultaneously interacts with external sources to gather additional data when needed. By integrating both internal reasoning and external knowledge, ReAct offers a flexible and general framework that excels across a variety of tasks, ranging from question answering and fact verification to text-based games and web navigation. With the help of the Google Security Team, we tested this idea and observed that, depending on factors like the generation seed and temperature (all the usual probabilistic LLM nuances), we could occasionally access what appeared to be a more privileged sandbox.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Google

Google

Photo of source code

source code

Photo of A.I Gemini

A.I Gemini

Related news:

News photo

Google Pixel 9a release date set for April 10 after delay

News photo

Google will stop making the Nest Protect smoke alarm

News photo

Google rolls out user choice billing on Google Play in the UK