Abstract
In this chapter, we introduce the information nonanticipative rate distortion function (RDF), and we compare it with the classical information RDF, identifying certain limitations of the later, with respect to nonanticipative or real-time transmission for delay-sensitive applications. Then, we proceed further to describe applications of nonanticipative RDF in (1) joint source-channel coding (JSCC) using nonanticipative (delayless) transmission, and in (2) bounding the optimal performance theoretically attainable (OPTA) by noncausal and causal codes for general sources. Finally, to facilitate the application of the information nonanticipative RDF in computing the aforementioned bounds and in applying it to JSCC based on nonanticipative transmission, we proceed further to present the expression of the optimal reproduction distribution for nonstationary sources.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
\(\otimes \) denotes convolution of distributions.
References
Berger T (1971) Rate distortion theory: a mathematical basis for data compression. Prentice-Hall, Englewood Cliffs
Neuhoff DL, Gilbert RK (1982) Causal source codes. IEEE Trans Inf Theor 28(5):701–713
Charalambous CD, Farhadi A (2008) LQG optimality and separation principle for general discrete time partially observed stochastic systems over finite capacity communication channels. Automatica 44(12):3181–3188
Charalambous CD, Kourtellaris CK, Hadjicostis C (2011) Optimal encoder and control strategies in stochastic control subject to rate constraints for channels with memory and feedback. In: 50th IEEE CDC/ECC, 12–15 Dec 2011, pp 4522-â4527
Charalambous CD, Stavrou PA (2012) Directed information on abstract spaces: properties and extremum problems. In: IEEE international symposium on information theory (ISIT), Cambridge, MA, USA, 1-â6 Jul 2012, pp 518–522
Stavrou PA, Kourtellaris CK, Charalambous CD (2014) Information nonanticipative rate distortion function and its applications. IEEE Trans Inf Theor (submitted) [Online]. Available: http://arxiv.org/abs/1405.1593v1
Berger T (1977) Explicit bounds to R(D) for a binary symmetric Markov source. IEEE Trans Inf Theor 23(1):52–59
Berger T (2003) Living information theory. IEEE Inf Theor Soc Newslett 53(1):6–19
Charalambous CD, Stavrou PA, Ahmed NU (2014) Nonanticipative rate distortion function and relations to filtering theory. IEEE Trans Autom Control 59(4):357–352
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Stavrou, P.A., Kourtellaris, C.K., Charalambous, C.D. (2015). Information Nonanticipative Rate Distortion Function and Its Applications. In: van Schuppen, J., Villa, T. (eds) Coordination Control of Distributed Systems. Lecture Notes in Control and Information Sciences, vol 456. Springer, Cham. https://doi.org/10.1007/978-3-319-10407-2_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-10407-2_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10406-5
Online ISBN: 978-3-319-10407-2
eBook Packages: EngineeringEngineering (R0)