Get the latest tech news
Google Gemini has the worst LLM API
Google Gemini has the worst LLM API
It’s not unusual to offer an enterprise API with stronger security or compliance guarantees, but slower feature roll-out. Not Vertex AI SDK, you’re going to need to figure out their auth methods and the right way to store their credentials.json file in your secrets system. The moment you’re dealing with large contexts that are dynamic but re-used, you need to build your own system to keep track of what caches correspond to what data.
Or read this on Hacker News
