Rolling Diffusion Models

Rolling Diffusion Models

2024 | David Ruhe, Jonathan Heek, Tim Salimans, Emiel Hoogeboom
This paper introduces *Rolling Diffusion Models*, a novel approach to diffusion models that progressively corrupts data over time. Unlike traditional diffusion models, which treat subsequent frames equally in terms of noise, Rolling Diffusion assigns more noise to frames that appear later in a sequence, reflecting greater uncertainty about the future. This method is particularly effective for temporal data such as videos, fluid mechanics simulations, and climate data. Empirical results demonstrate that Rolling Diffusion outperforms standard diffusion models in complex temporal dynamics, as shown in video prediction tasks using the Kinetics-600 dataset and chaotic fluid dynamics forecasting experiments. The paper also discusses the background of diffusion models, the motivation for Rolling Diffusion, and its implementation details, including training and sampling procedures. Additionally, it compares Rolling Diffusion with related work and presents experimental results on various datasets, highlighting its effectiveness in dynamic settings.This paper introduces *Rolling Diffusion Models*, a novel approach to diffusion models that progressively corrupts data over time. Unlike traditional diffusion models, which treat subsequent frames equally in terms of noise, Rolling Diffusion assigns more noise to frames that appear later in a sequence, reflecting greater uncertainty about the future. This method is particularly effective for temporal data such as videos, fluid mechanics simulations, and climate data. Empirical results demonstrate that Rolling Diffusion outperforms standard diffusion models in complex temporal dynamics, as shown in video prediction tasks using the Kinetics-600 dataset and chaotic fluid dynamics forecasting experiments. The paper also discusses the background of diffusion models, the motivation for Rolling Diffusion, and its implementation details, including training and sampling procedures. Additionally, it compares Rolling Diffusion with related work and presents experimental results on various datasets, highlighting its effectiveness in dynamic settings.
Reach us at info@study.space