Compressing Distributions
Yang Qiu
Abstract:
Inspired by the texture model proposed by Portilla and Simonchelli and the texture tiling model from Rosenholtz et al., we study the rate-distortion theory of lossy compression of distributions. In particular, we examine some asymptotic behavior of rate-distortion function for the following instances: when the source and reconstruction are empirical distribution of samples drawn from discrete spaces, when the source and reconstruction and Gaussian distributions, and when the source and reconstruction are empirical distribution of samples drawn from Gaussian distributions.