Derives the optimal quantizer of a real-valued random variable with a specified output distribution and minimum mean squared error.
Provides a general framework for deriving optimal quantizers with specified output distributions, which is novel compared to prior work.
Before reading this…
Applications
- →Designing quantizers with controlled output entropy
- →Maximizing mutual information between input and output
- →Tailoring output distribution to match channel input requirements
- →Data anonymization
To understand this paper, make sure you know these concepts first:
- Probability theoryfind papers →
- Random variablesfind papers →
Abstract
More Like ThisWe derive the optimal quantizer of a real-valued random variable $W$ with distribution $P_W$ such that 1) the distribution of the quantization output $X$ that can take $k$ values follows any specified distribution $P_X$ over $\{1,\ldots,k\}$, and 2) the minimum mean squared error (MMSE) of estimating $W$ from $X$ is minimized. It is shown that the optimal quantizer takes the form $X=σ\big(F_{σ^{-1}(X)}^{-1}(F_W(W))\big)$, where $σ$ is the optimal permutation of $\{1,\ldots,k\}$ among all permutations to minimize the MMSE, and $F$ is the cumulative distribution function. When $P_W$ is uniform over an interval or $P_X$ is uniform over $\{1,\ldots,k\}$, the quantizer takes a simple form $X=F_{X}^{-1}(F_W(W))$. The concept of majorization plays a key role in the optimality proof. Specifying the output distribution is useful for designing quantizers with explicitly controlled output entropy, maximized mutual information between input and output, tailored output distribution to match channel input requirements for communication, and data anonymization.