Vidu是由北京生数科技有限公司与清华大学联合发布的中国首个长时长、高一致性、高动态性AI视频生成大模型

Vidu是由北京生数科技有限公司与清华大学联合发布的中国首个长时长、高一致性、高动态性AI视频生成大模型。该模型采用原创的Diffusion与Transformer融合的架构U-ViT，支持一键生成长达16秒、1080P分辨率的高清视频。

主要功能

长时高清视频生成

• Vidu能够根据用户的文本描述，一键生成长达16秒的高清视频，分辨率达到1080P。

多镜头生成

• 支持生成包含远景、近景、中景和特写等多种镜头的复杂场景，能够模拟真实物理世界并保持高度一致的时空连续性。

文生视频和图生视频

• 提供从文本到视频（文生视频）和从图片到视频（图生视频）两大核心功能，支持4秒和8秒两种时长选择，分辨率最高达1080P。

快速生成

• Vidu实现了业界最快的实测推理速度，生成一段4秒片段仅需30秒。

高质量画面

• 在构图、叙事和光影等方面，Vidu能够达到接近电影级效果，并能生成影视级特效画面，如烟雾、炫光效果、CG特效等。

角色一致性和特效

• 新增了角色一致性（Character To Video）、动漫风格、文字与特效画面生成等特色能力，用户可以通过上传角色图和文字描述来指定角色的场景和动作。

免费版

• 每月有80积分，可生成20个4秒视频。

收费版

Vidu提供按月度和年度订阅的收费机制，分为标准版、高级版和尊享版。

按月度订阅

• 标准版：19.99美元/月（约合人民币145.22元），每月可额外获得240积分，视频时长延长到8秒，可去水印和商用。
• 高级版：59.99美元/月（约合人民币435.80元），每月可额外获得800积分，视频时长延长到8秒，可去水印和商用。
• 尊享版：199.99美元/月（约合人民币1452.83元），每月可额外获得2880积分，视频时长延长到8秒，可去水印和商用。

按年度订阅

• 标准版：7.99美元/月（约合人民币57.80元），每月可额外获得240积分，视频时长延长到8秒，可去水印和商用。
• 高级版：23.99美元/月，每月可额外获得800积分，视频时长延长到8秒，可去水印和商用。
• 尊享版：79.99美元/月，每月可额外获得2880积分，视频时长延长到8秒，可去水印和商用。

内容创作

• 视频创作：为视频创作者提供强大的工具，简化视频制作过程，提高工作效率。
• 广告制作：通过生成高质量的广告视频，提升品牌宣传效果。

教育

• 虚拟课堂：用于虚拟课堂、实验演示和教学模拟等场景，帮助学生更好地理解复杂的概念。
• 教学视频：生成教学视频和培训材料，提升教育内容的生动性和互动性。

营销和广告

• 数字营销：快速生成高质量的广告视频和社交媒体内容，提升品牌曝光度和用户参与度。
• 个性化视频：为销售团队提供个性化视频生成工具，增强客户互动和销售转化率。

娱乐

• 短视频创作：生成吸引眼球的短视频内容，用于社交媒体平台或概念展示。
• 影视制作：生成高质量的特效画面和复杂的动态场景，适用于电影和电视制作。

科研和培训

• 实验模拟：科研人员可以使用Vidu模拟实验场景，帮助展示和验证研究成果。
• 培训视频：生成培训视频，提升培训效果和员工技能。

文化推广

• 文化展示：生成展示中国文化元素的视频，用于旅游宣传或文化交流项目。

游戏制作

• 游戏场景生成：用于游戏制作中的场景生成和角色动画，提升游戏的视觉效果和互动性。

其他应用

• 表情包和梗图：利用角色一致性功能，生成有趣的表情包和梗图。
• 概念展示：用于产品概念展示和设计验证，提升产品开发效率。

Vidu目前是闭源的，这意味着其源代码不对外公开，用户需要通过订阅或购买许可证来使用其功能。

Vidu is China’s first AI video generation model for long-duration, high-consistency, and dynamic videos, jointly developed by Beijing Shenshu Technology Co., Ltd. and Tsinghua University. The model uses an original architecture that integrates Diffusion and Transformer called U-ViT, allowing users to generate high-definition videos up to 16 seconds long and 1080P resolution with just one click.

Key Features

1. Long-duration HD Video Generation
   • Vidu can generate HD videos up to 16 seconds long based on text descriptions, with a resolution of 1080P.
2. Multi-angle Generation
   • Supports complex scenes with various camera angles, such as long shots, close-ups, medium shots, and more. It simulates real-world physics while maintaining high temporal and spatial continuity.
3. Text-to-Video and Image-to-Video
   • Provides two core functions: text-to-video and image-to-video, with options to generate 4-second and 8-second videos at a resolution of up to 1080P.
4. Fast Generation
   • Vidu offers the industry’s fastest tested inference speed, generating a 4-second clip in just 30 seconds.
5. High-quality Visuals
   • Vidu excels in composition, storytelling, and lighting, achieving near-cinematic effects and generating film-quality visual effects such as smoke, lens flares, and CG effects.
6. Character Consistency and Special Effects
   • Features like character consistency (Character to Video), anime style, and text-with-special-effects generation allow users to specify scenes and actions for characters by uploading images and descriptions.

Free Version

• Users receive 80 points per month, allowing them to generate 20 videos of 4 seconds each.

Paid Versions

Vidu offers both monthly and annual subscription plans, divided into Standard, Premium, and Ultimate versions.

Monthly Subscription

• Standard: $19.99/month (about 145.22 RMB), includes 240 extra points per month, video duration extended to 8 seconds, watermark removal, and commercial usage rights.
• Premium: $59.99/month (about 435.80 RMB), includes 800 extra points per month, 8-second video duration, watermark removal, and commercial usage rights.
• Ultimate: $199.99/month (about 1452.83 RMB), includes 2880 extra points per month, 8-second video duration, watermark removal, and commercial usage rights.

Annual Subscription

• Standard: $7.99/month (about 57.80 RMB), includes 240 extra points per month, 8-second video duration, watermark removal, and commercial usage rights.
• Premium: $23.99/month, includes 800 extra points per month, 8-second video duration, watermark removal, and commercial usage rights.
• Ultimate: $79.99/month, includes 2880 extra points per month, 8-second video duration, watermark removal, and commercial usage rights.

Content Creation

• Video Creation: Provides powerful tools for video creators, simplifying the production process and improving efficiency.
• Ad Production: Generates high-quality advertisement videos, enhancing brand promotion.

Education

• Virtual Classrooms: Useful for virtual classrooms, experiment simulations, and teaching demonstrations, helping students better understand complex concepts.
• Teaching Videos: Creates engaging teaching videos and training materials to enhance the interactivity of educational content.

Marketing and Advertising

• Digital Marketing: Quickly generates high-quality ad videos and social media content to increase brand visibility and user engagement.
• Personalized Videos: Provides personalized video generation tools for sales teams, enhancing customer interactions and conversion rates.

Entertainment

• Short Video Creation: Generates eye-catching short videos for social media platforms or concept presentations.
• Film Production: Creates high-quality special effects and complex dynamic scenes suitable for film and television production.

Research and Training

• Experiment Simulation: Researchers can use Vidu to simulate experimental scenarios, aiding in the demonstration and validation of research results.
• Training Videos: Generates training videos to improve training outcomes and employee skills.

Cultural Promotion

• Cultural Display: Creates videos showcasing elements of Chinese culture, useful for tourism promotion or cultural exchange projects.

Game Development

• Game Scene Generation: Useful for generating game scenes and character animations, enhancing the visual effects and interactivity of games.

Other Applications

• Emojis and Memes: Uses the character consistency feature to generate fun emojis and meme content.
• Concept Showcasing: Used for product concept demonstrations and design validation, boosting product development efficiency.

Vidu is currently closed-source, meaning its code is not publicly available. Users need to subscribe or purchase a license to access its features.