Latent Dirichlet Allocation (LDA) with Gibbs Sampling Explained

In this video I explain LDA and go through a tutorial paper on how it works using collapsed gibbs sampling. The next video will be a implementation video :)

This method is an old school method and it's not clear how useful it is today, but a lot of course teach this topic so it must have some historical value I feel. It's one of Andrew Ng's most cited papers!

Paper tutorial: https://coli-saar.github.io/cl....19/materials/darling

Timestamps:
0:00 - Introduction
1:18 - What is topic modelling?
2:41 - LDA
13:30 - Posterior Inference
15:09 - Gibbs Sampling
18:06 - Collapsed Gibbs
21:50 - Finding conditional probability
26:48 - Implementation
30:08 - Pseudo code
32:25 - Ending