Get the latest tech news
Open Platform For Enterprise AI's GenAI Code Adds Guardrails, AMD EPYC Support
The Open Platform for Enterprise AI 'OPEA' that is a sub-project of the Linux Foundation and backed by a wide variety of different organizations to provide open solutions for Generative AI announced today their newest GenAI code examples.
OPEA 1.4 is now available to provide the latest Generative AI Examples that work on hardware/software from multiple vendors and leveraging open-source. OPEA's guardrails include the abilities to filter competitor mentions, banning sensitive substrings (words), banning different topics like violence / attack / war are noted, disabling bias, filtering programming languages that are supported or not, blocking malicious URLs, factual consistency settings, and scanning for sensitive topics and toxicity. In addition to the new guardrails as part of OPEA GenAI capabilities, there is new fine-tuning of reasoning models, an LLM router for determining the downstream LLM serving endpoint is best suited for an incoming prompt, language detection, air-gapped environment support, and remote inference endpoints support.
Or read this on Phoronix
