Get the latest tech news
The Dark Side of Open Source AI Image Generators
Open source tools allow anyone to make AI art. They have also been used to produce nonconsensual deepfake porn.
4chan, the image-based message board site with a reputation for chaotic moderation is home to pages devoted to nonconsensual deepfake porn, WIRED found, made with openly available programs and AI models dedicated solely to sexual images. Other AI creators, including Cohen, are also concerned about the ease of creating deepfakes with a new method, InstantID, published in January by researchers at Peking University and Chinese social media company Xiaohongshu, which can be used to swap faces in images using just a single example, therefore needing less processing or preparation. When David Widder, an AI ethics researcher and postdoctoral fellow at Cornell Tech, interviewed the people behind an open source deepfake tool, they made clear that they did not want their software to be used for porn of any kind, consensual or nonconsensual.
Or read this on Wired
