Get the latest tech news
Nvidia’s new tool lets you run GenAI models on a PC
Nvidia has released a new tool, Chat with RTX, that allows users to run a GenAI model offline -- and fine-tune it on their data.
Called Chat with RTX, the tool allows users to customize a GenAI model along the lines of OpenAI’s ChatGPT by connecting it to documents, files and notes that it can then query. “For example, one could ask, ‘What was the restaurant my partner recommended while in Las Vegas?’ and Chat with RTX will scan local files the user points it to and provide the answer with context.” Nvidia also acknowledges that the relevance of the app’s responses can be affected by a range of factors, some easier to control for than others — including the question phrasing, the performance of the selected model and the size of the fine-tuning data set.
Or read this on TechCrunch
