D Harfi 👁 23 views

Diffusion Model

Starting from random noise, step by step is a meaningful visual or sound producing manufacturer model type.

The diffusion model, starting from random noise, is a kind of artificial intelligence model, which produces a meaningful and consistent visual, sound or video by stepping this noise. The training process is interestingly reversed: a real image is given before the model, and with small steps to this image, the increasing amount of random noise is added, the image is completely meaningless to the static noise. In every step of this process, the model learns to predict the added noise in that step. When the training is completed, this process is reversed: when the model is given pure random noise, the model gradually cleans the noise by repeating the noise removal steps and eventually reveals a consistent, realistic visual.

This approach offers a more stable educational process and a variety of higher quality outputs, usually compared to traction producers networks (GAN), which is popular before itself, so it is the basis of visual generation systems from today’s most recognized text, such as Stable Diffusion, Midjourney and DALL-E. In these systems, text input is often included in the process of noise removal through a text encoder (e.g. CLIP-like model), and the visual produced is consistent with text explanation. Difusion models are increasingly widely used in areas such as sound synthesis and video generation beyond visual production.