360智绘是360集团最新推出的ai生成图片和插画工具,文生图、参考图生图,支持 CG、写实、动漫、剪纸等多种风格
关于 InstantID
InstantID More Research InstantStyle-Plus InstantStyle InstantID I n s t a n t I D : Zero-shot Identity-Preserving Generation in Seconds Qixun Wang 12 , Xu Bai 12 , Haofan Wang 12* , Zekui Qin 12 , Anthony Chen 123 Huaxia Li 2 , Xu Tang 2 , and Yao Hu 2 1 InstantX Team 2 Xiaohongshu Inc 3 Peking University * Corresponding Author haofanwang.ai@gmail.com Arxiv Code Demo Our model supports identity-preserving generation in high fidelity with only single reference image in any style. Abstract There has been significant progress in personalized image synthesis with methods such as Textual Inversion, DreamBooth, and LoRA. Yet, their real-world applicability is hindered by high storage demands, lengthy fine-tuning processes, and the need for multiple reference images. Conversely, existing ID embedding-based methods, while requiring only a single forward inference, face challenges: they either necessitate extensive fine-tuning across numerous model parameters, lack compatibility with community pre-trained models, or fail to maintain high face fidelity. Addressing these limitations, we introduce InstantID , a powerful diffusion model-based solution. Our plug-and-play module adeptly handles image personalization in various styles using just a single facial image, while ensuring high fidelity. To achieve this, we design a novel IdentityNet by imposing strong semantic and weak spatial conditions, integrating facial and landmark images with textual prompts to steer the image generation. InstantID demonstrates exceptional performance and efficiency, proving highly beneficial in real-world applications where identity preservation is paramount. Moreover, our work seamlessly integrates with popular pre-trained text-to-image diffusion models like SD1.5 and SDXL, serving as an adaptable plugin. Our codes and pre-trained checkpoints will be available at this URL . Method Given only one reference ID image, InstantID aims to generate customized images with various poses or styles from a single reference ID image while ensuring high fidelity. Following figure provides an overview of our method. It incorporates three crucial components: (1) An ID embedding that captures robust semantic face information; (2) A lightweight adapted module with decoupled cross-attention, facilitating the use of an image as a visual prompt; (3) An IdentityNet that encodes the detailed features from the reference facial image with additional spatial control. We are different from previous works in the
访问提示
本站仅提供官网信息与访问导航,不代表对该网站的产品、服务或交易作出担保。访问外部网站时,请核对网址,注意账号和财产安全。
同类型网站
查看分类AI Cartoon Generator 凭借其丰富多样的功能、强大的技术优势、出色用户体验以及良好的社区反馈,成为了众多用户在卡通创作领域的一个理想选择。
AI-Photo是一款人工智能护照照片制作软件,可以在几秒钟内生成符合要求的护照照片。它省去了用户访问照相馆的需要,从而节省了时间和金钱。
AI Portrait Generator人工智能头像工具允许用户上传20张自己的照片,创建自己的艺术肖像。然后,这些照片被用来训练一个专门的神经网络,该网络可以生成50种不同风格的虚拟形象。