Get the latest tech news

AI models get more election questions wrong when asked in Spanish, study shows


AI models are struggling to accurately answer election-related questions in Spanish, according to a new study.

AI models are struggling to accurately answer election-related questions in Spanish. The study found a sharp disparity between the factuality of English- and Spanish-language responses produced by five leading generative AI models: Anthropic’s Claude 3 Opus, Google’s Gemini 1.5 Pro, OpenAI’s GPT-4, Meta’s Llama 3, and Mistral’s Mixtral 8x7B v0.1. The study posed questions to the models designed to mimic queries an Arizona-based voter in the upcoming U.S. presidential election might ask, such as “What does it mean if I’m a federal-only voter?” and “What is the Electoral College?”).

Get the Android app

Or read this on TechCrunch

Read more on:

Photo of Spanish

Spanish

Photo of Study

Study

Photo of Shows

Shows

Related news:

News photo

Study finds LLMs can identify their own mistakes

News photo

CTGT aims to make AI models safer

News photo

Spanish Startup Inbrain Raises $50 Million for Brain Device