AutoGPT 是面向自主智能体的开源平台,支持用自然语言或可视化流程创建、运行和管理能够持续执行任务的智能体。
关于 AtomoVideo
AtomoVideo: High Fidelity Image-to-Video Generation AtomoVideo: High Fidelity Image-to-Video Generation Litong Gong*, Yiran Zhu*, Weijie Li*, Xiaoyang Kang*, Biao Wang, Tiezheng Ge, Bo Zheng Alibaba Inc.    * Equal Contribution arXiv YouTube One-minute Video AtomoVideo is a novel high-fidelity image-to-video (I2V) generation framework that generates high-fidelity video from input images, achieves better motion intensity and consistency than existing work, and is compatible with various personalized T2I models without specific tuning. Image-to-Video Examples Comparisons with Other Methods Image AtomoVideo Gen-2 Pika 1.0 Image AtomoVideo Gen-2 Pika 1.0 Image AtomoVideo Gen-2 Pika 1.0 Image AtomoVideo Gen-2 Pika 1.0 Abstract Recently, video generation has achieved significant rapid development based on superior text-to-image generation techniques. In this work, we propose a high fidelity framework for image-to-video generation, named AtomoVideo. Based on multi-granularity image injection, we achieve higher fidelity of the generated video to the given image. In addition, thanks to high quality datasets and training strategies, we achieve greater motion intensity while maintaining superior temporal consistency and stability. Our architecture extends flexibly to the video frame prediction task, enabling long sequence prediction through iterative generation. Furthermore, due to the design of adapter training, our approach can be well combined with existing personalised models and controllable modules. By quantitatively and qualitatively evaluation, AtomoVideo achieves superior results compared to popular methods. Framework The framework of our image-to-video method. We use the pre-trained T2I model, newly added 1D temporal convolution and temporal attention modules after every spatial convolution and attention layer, with fixed T2I model parameters and only training the added temporal layer. Meanwhile, in order to inject the image information, we modify the input channel to 9 channels, add the image condition latent and binary mask. Since the input concatenate image information is only encoded by VAE, it represents low-level information, which contributes to the enhancement of fidelity of the video with respect to the given image. Meanwhile, we also inject high-level image semantic in the form of cross-attention to achieve more semantic image controllability. BibTeX @misc{atomovideo, title={AtomoVideo: High Fidelity Image-to-Video Generation}, author={Gon
访问提示
本站仅提供官网信息与访问导航,不代表对该网站的产品、服务或交易作出担保。访问外部网站时,请核对网址,注意账号和财产安全。
同类型网站
查看分类百川智能发布的金融大模型,金融场景能力领先GPT-4o近20%
Build a Large Language Model (From Scratch) 是一款AI 大模型方向的 AI 工具,适合主流大语言模型与开源模型。
支持多 AI Agent 框架的可视化管理面板,支持 OpenClaw 和 Hermes Agent 双引擎,内置智能助手一键安装诊断