[ML/Statistics] Exponential, Gamma, Beta, Dirichlet Distributions and Dirichlet Process

Exponential Distribution Gamma Function & Distribution Beta Distribution Dirichlet Distribution & Dirichlet Process

2024, Feb 15   —  1 minute read

[Graph Theory] Markov Chains : Part 1 - Basic Properties and Classfications of Markov Chains

Outlines References 1. Markov Process 2. Evolution of Markov Chains 2.1. Stationary Distribution and Eigendecomposition...

2024, Jan 05   —  14 minute read

[Paper Review] Sharpness-Aware Minimization for Efficiently Improving Generalization (SAM, 2021)

Outlines References 1. Weak Generalization Power of Sharp Minima 2. Sharpness-Aware Minimization (SAM) 2.1. PAC...

2023, Dec 07   —  6 minute read

[ML] PAC-Bayes Bound : Measure for Generalization Ability of Learned Predictors

References An Introduction to PAC-Bayes User-friendly introduction to PAC-Bayes bounds, Alquier et al., 2021 PAC...

2023, Dec 06   —  1 minute read

[Tensor Calculus] Notes on Tensor Calculus

Notes 01_Recap_Multivariate Calculus 02_Covector and Contravariance 03_Tensor Product - Raising and Lower Index with Metric...

2023, Nov 29   —  1 minute read

[Paper Review] A Short Tutorial on The Weisfeiler-Lehman Test And Its Variants

Outlines Reference 1. Weisfeiler-Lehman Graph Isomorphism Test 1.1. WL Test 1.2. k-WL Test 1.3. k-FWL...

2023, Nov 22   —  5 minute read

[Papers Review] Summaries of Papers Focusing on Graph Rewiring to Address Over-Squashing

Note that all summaries here are for personal purpose to better understand mathematical details of...

2023, Nov 14   —  3 minute read

[RL] Notes on Reinforcement Learning (RL)

Notes 01. Q-Learning and Markov Decision Process (MDP) 02. Bellman Expectation Equations 03. Bellman Optimality...

2023, Nov 11   —  1 minute read

[Paper Review] Auto-Encoding Variational Bayes (Variational AutoEncoder, VAE) (2013)

Paper Auto-Encoding Variational Bayes (Kingma, D.P. and Welling, M, 2013) Summary Variational AutoEncoder, VAE

2023, Oct 24   —  1 minute read

[Papers Review & Implementation] Hyperbolic Neural Networks - Part 2 : Implementing Hyperbolic Graph Convolutional Networks (HGCN)

Outlines Reference HGCN : Implementing GCN in Hyperbolic Space 0. Hyperboloid Model 1. HGCN Layer...

2023, Oct 23   —  35 minute read