Note: Brainstorming and Current Progress

Posted by Allan on January 9, 2023

About Enlightening

  • [] See if the process of short exposure image is apporxiable by adding gaussian noise

  • [] See if a model can be used to formulate the image darken to generate more data

  • [] See if we can use diffusion forward to approx. a darken image generation

  • [] See if we can retrain a VAE to accept RAW

About LDM

  • [] Add a shortcut to UNet part and see if the information is more deterministic

LDM progress

Work Progress      
Understand DDPM Math background [x]      
Understand Classification and Classifier Free Method [x]      
Understand VQ-VAE and VQ-GAN        
Understand LDM        
Modify LDM VAE part        

About Action Spotting

  • [] See if we can use ActionFormer to plug in SoccerNet dataset