News on Medial

Diffusion transformers are the key behind OpenAI's Sora -- and they're set to upend GenAI

TechCrunchTechCrunch Ā· 9m
Diffusion transformers are the key behind OpenAI's Sora -- and they're set to upend GenAI

OpenAI's latest advancement in GenAI, Sora, demonstrates the potential of the diffusion transformer, an AI model architecture that combines diffusion and the transformer. This architecture, already used by Stability AI's Stable Diffusion 3.0, allows GenAI models to scale up beyond previous limitations. Unlike traditional models that relied on U-Nets, the diffusion transformer uses transformers, known for their attention mechanism, offering improved performance and scalability. Sora is a significant leap in effectiveness and can handle vast amounts of video data. Integration of content understanding and creation within the diffusion transformer framework is a future goal, making transformers a preferred choice in the GenAI field.

Comments

Download the medial app to read full posts, comements and news.