High-SNR Capacity of AWGN Channels with Generic Alphabet Constraints
MIT Lincoln Laboratory Lexington United States
Pagination or Media Count:
We present a generalized notion of entropy taken with respect to a measure in acoordinate-independent manner and prove several novel entropy convergence theorems. A particular focus is entropy of random variables on smooth submanifolds of RN. We apply these results to computing the information capacity of an AWGN channel whose alphabet is constrained to an n-dimensional smooth submanifold of RN. Such submanifolds are shown to arise naturally when coding alphabets in RN are subjected to a set of smooth constraint functions. The asymptotic capacity in the high-SNR limit is computed for such AWGN channels with manifold constraints in two variants a compact alphabet manifold, and a non-compact scale-invariant alphabet manifoldwith an additional average power constraint on the input distribution. The high-SNR capacity expression resembles Shannons famous Gaussian channel capacity formula, with an additional constant term determined by the geometry of the alphabet constraint manifold namely, a volume derived from the manifold. We apply the above theory in a study of the channel capacity of radar pulse waveforms. In our model, each radar pulse also constitutes a code letter for transmission of information. It is desirable in this context to constrain the alphabet of waveforms to those particularly suited to efficient and effective radar signal processing, giving rise to a channel described by the above work. We numerically compute the volume component of our asymptotic capacity expression for a plausible range of performance characteristics of the radar signal processing. We plot curves that show the inherent trade-off for our radar between signal processing performance and channel capacity.
- Theoretical Mathematics