对着麦克风说话,AI实时生成你的数字分身视频
你对着麦克风说一句,屏幕里的数字人就能实时做出反应——不是录好的,是AI当场生成的。Vidu S1做到了:用普通显卡就能跑,540p分辨率下每秒42帧,不模糊、不漂移、不扭曲,而且可以无限长地生成下去。你上传一张真人、动漫角色或宠物的照片,选个声音,然后像直播一样说话,画面里的角色就会同步动起来。它不是你明天就能用来做电影的工具,但如果你想要一个能实时互动的虚拟形象——比如直播助手、在线教学的数字老师、或者游戏里的动态NPC——这条路已经通了。
📄 原文摘要(英文)
We introduce Vidu S1, a real-time interactive video generation model supporting voice control of digital characters. Users can control video generation content at any moment through voice instructions. Vidu S1 supports infinite-length real-time video generation without blurring, drift, or visual distortion. Built with TurboDiffusion and TurboServe, Vidu S1 outputs 540p real-time videos at up to 42 FPS on regular consumer GPUs. Users can upload custom images of real people, anime, and pets, and choose different voice tones for personalized experiences. Experiments show that Vidu S1 achieves the best performance across all test metrics while fully meeting real-time inference requirements. A playable online demo is available at https://vidu.com/vidu-stream.