How Information Bottleneck Helps Representation Learning

April 1, 2024 · 25 min read

An overview connecting rate-distortion theory, VIB, and beta-VAE under the information bottleneck lens.