Login

News on Medial

Diffusion transformers are the key behind OpenAI's Sora -- and they're set to upend GenAI

TechCrunchTechCrunch · 8m
Diffusion transformers are the key behind OpenAI's Sora -- and they're set to upend GenAI

OpenAI's latest advancement in GenAI, Sora, demonstrates the potential of the diffusion transformer, an AI model architecture that combines diffusion and the transformer. This architecture, already used by Stability AI's Stable Diffusion 3.0, allows GenAI models to scale up beyond previous limitations. Unlike traditional models that relied on U-Nets, the diffusion transformer uses transformers, known for their attention mechanism, offering improved performance and scalability. Sora is a significant leap in effectiveness and can handle vast amounts of video data. Integration of content understanding and creation within the diffusion transformer framework is a future goal, making transformers a preferred choice in the GenAI field.

3
View Source

Comments

More Like this

OpenAI’s Sora Turns AI Prompts Into Photorealistic Videos

OpenAI’s Sora Turns AI Prompts Into Photorealistic Videos

From toy to tool: DALL-E 3 is a wake-up call for visual artists—and the rest of us

From toy to tool: DALL-E 3 is a wake-up call for visual artists—and the rest of us

Sam Altman is trying to convince Hollywood that Sora won't destroy the movie business

Sam Altman is trying to convince Hollywood that Sora won't destroy the movie business

Italy's data watchdog looks into OpenAI tool that turns text into video

Italy's data watchdog looks into OpenAI tool that turns text into video

OpenAI’s Sora text-to-video generator will be publicly available later this year

OpenAI’s Sora text-to-video generator will be publicly available later this year

OpenAI’s Sora Is Coming for Your Video Games

OpenAI’s Sora Is Coming for Your Video Games

Leveraging LLMs And Diffusion Models For Dynamic Content Creation

Leveraging LLMs And Diffusion Models For Dynamic Content Creation

Stability announces Stable Diffusion 3, a next-gen AI image generator

Stability announces Stable Diffusion 3, a next-gen AI image generator

North American business plans to invest 67% more in GenAI in 2024, says Infosys Research

North American business plans to invest 67% more in GenAI in 2024, says Infosys Research

Stability AI releases Stable Doodle, a sketch-to-image tool

Stability AI releases Stable Doodle, a sketch-to-image tool

Download the medial app to read full posts, comements and news.