Sora: A review on background, technology, limitations, and opportunities of large vision models
Sora is a text-to-video generative AI model, released by OpenAI in February 2024. The
model is trained to generate videos of realistic or imaginative scenes from text instructions …
model is trained to generate videos of realistic or imaginative scenes from text instructions …
State of the art on diffusion models for visual computing
The field of visual computing is rapidly advancing due to the emergence of generative
artificial intelligence (AI), which unlocks unprecedented capabilities for the generation …
artificial intelligence (AI), which unlocks unprecedented capabilities for the generation …
Vbench: Comprehensive benchmark suite for video generative models
Video generation has witnessed significant advancements yet evaluating these models
remains a challenge. A comprehensive evaluation benchmark for video generation is …
remains a challenge. A comprehensive evaluation benchmark for video generation is …
Videopoet: A large language model for zero-shot video generation
We present VideoPoet, a language model capable of synthesizing high-quality video, with
matching audio, from a large variety of conditioning signals. VideoPoet employs a decoder …
matching audio, from a large variety of conditioning signals. VideoPoet employs a decoder …
When does Sora show: The beginning of TAO to imaginative intelligence and scenarios engineering
During our discussion at workshops for writing “What Does ChatGPT Say: The DAO from
Algorithmic Intelligence to Linguistic Intelligence”[1], we had expected the next milestone for …
Algorithmic Intelligence to Linguistic Intelligence”[1], we had expected the next milestone for …
Sora for senarios engineering of intelligent vehicles: V&V, C&C, and beyonds
The advent of Scenarios Engineering (SE) paves the way to a new era of intelligent vehicles
(IVs), driven by Artificial Intelligence (AI)-enabled strategies. It aims at shaping the IVs to be …
(IVs), driven by Artificial Intelligence (AI)-enabled strategies. It aims at shaping the IVs to be …
V3d: Video diffusion models are effective 3d generators
Automatic 3D generation has recently attracted widespread attention. Recent methods have
greatly accelerated the generation speed, but usually produce less-detailed objects due to …
greatly accelerated the generation speed, but usually produce less-detailed objects due to …
Anyv2v: A plug-and-play framework for any video-to-video editing tasks
Video-to-video editing involves editing a source video along with additional control (such as
text prompts, subjects, or styles) to generate a new video that aligns with the source video …
text prompts, subjects, or styles) to generate a new video that aligns with the source video …
Cameractrl: Enabling camera control for text-to-video generation
Controllability plays a crucial role in video generation since it allows users to create desired
content. However, existing models largely overlooked the precise control of camera pose …
content. However, existing models largely overlooked the precise control of camera pose …
Vasa-1: Lifelike audio-driven talking faces generated in real time
We introduce VASA, a framework for generating lifelike talking faces with appealing visual
affective skills (VAS) given a single static image and a speech audio clip. Our premiere …
affective skills (VAS) given a single static image and a speech audio clip. Our premiere …