Get the latest tech news
TokenVerse: Multi-Concept Personalization in Token Modulation Space by Google
Versatile Multi-concept Personalization in Token Modulation Space.
Our method leverages the exisitng modulation mechanism in DiT models to extract concept specific information from user provided images. (b) In our TokenVerse method, given a concept image and its corresponding caption, we learn a personalized modulation vector adjustment delta for each text embedding. (c) At inference, the pre-learned direction vectors are added to the text embeddings, enabling injection of personalized concepts into the generated images.
Or read this on Hacker News
