Andy Blog

Why are you interesting in this website?

Hello 2023

Convex subdifferential This is the first blog Math example \[\int^\infty_0 x dx\]

Posted by Andy on January 13, 2023

Code Review: Denoising Diffusion Probabilistic Models (DDPM)

Introduction DDPM maths background and introduction can refer to Review: Denoising Diffusion Probabilistic Models (DDPM) In short, we have a the following training algorithm to be implemented ...

Posted by Allan on January 10, 2023

Note: Brainstorming and Current Progress

About Enlightening [] See if the process of short exposure image is apporxiable by adding gaussian noise [] See if a model can be used to formulate the image darken to generate mo...

Posted by Allan on January 9, 2023

Review: High-Resolution Image Synthesis with Latent Diffusion Models (LDM)

Latent diffusion model (LDM) Latent diffusion model(LDM) (Rombach & Blattmann, et al. 2022) runs the diffusion process in the latent space instead of pixel space, making training cost lower an...

Posted by Allan on December 29, 2022

Review: Denoising Diffusion Implicit Models (DDIM)

Denoising Diffusion Implicit Models (DDIM) Song et. al. (2022) introduced Denoising Diffusion Implicit Models. The concept of DDIM is to apply a new sampling method s.t. the denoising process can ...

Posted by Allan on December 22, 2022

Review: Denoising Diffusion Probabilistic Models (DDPM)

What are Diffusion Models? Denoising Diffusion Probabilistic Models (DDPM) is introduced in (Ho et al., 2020). The maths background is discussed (Sohl-Dickstein et al., 2015). The essential idea i...

Posted by Allan on December 21, 2022

Review: Denoising Diffusion Probabilistic Models (DDPM) from Bayes' Theorem

DDPM Explanation by Bayes’ Perspective In the following session, we will discuss the DDPM forward and backward pass via Bayes’ Theorem. It help the speed up introduced in DDIM. Recall of Completi...

Posted by Allan on December 21, 2022

Cheatsheet: Basic Probability

Basic Definition The probability of an event can only be between 0 and 1 and can also be written as a percentage. The probability of event A is often written as $P(A)$ Subset of sample spaces

Posted by Allan on December 14, 2022

Reparameterization Trick

Need to be fixed, rewrite when learning VAE Refer to Figure 1: Reparameterization Trick illustration Simple Example Assume we define \[\begin{aligned} x \sim f_X(x)\\ y = h(x); \\ ...

Posted by Allan on December 9, 2022

Cheatsheet: Markdown

This is a very simple markdown cheatsheet for me to recap all command and syntax to write a markdown file. Title 1 # Title Subtitle 1 ## Subtitle Smaller subtitle 1 ### Smaller subtitle T...

Posted by Allan on December 8, 2022