Get the latest tech news

Mistral AI takes on OpenAI with new moderation API, tackling harmful content in 11 languages

Mistral AI launches a powerful multilingual content moderation API to challenge OpenAI, addressing growing concerns about AI safety with advanced tools to detect harmful content across nine categories.

The moderation API is already being used in Mistral’s own Le Chat platform and supports 11 languages, including Arabic, Chinese, English, French, German, Italian, Japanese, Korean, Portuguese, Russian, and Spanish. While companies like OpenAI and Anthropic have focused primarily on cloud-based solutions, Mistral’s strategy of enabling both on-device AI and content moderation addresses growing concerns about data privacy, latency, and compliance. By training its moderation model to understand conversational context rather than just analyzing isolated text, Mistral has created a system that can potentially catch subtle forms of harmful content that might slip through more basic filters.

Get the Android app