Kolmogorov Complexity and Information Theory: With an Interpretation in Terms of Questions and Answers

We compare the elementary theories of Shannon information and Kolmogorov complexity, the extent to which they have a common purpose, and where they are fundamentally different. We discuss and relate the basic notions of both theories: Shannon entropy, Kolmogorov complexity, Shannon mutual informatio...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:Journal of Logic, Language, and Information. - Springer Science + Business Media. - 12(2003), 4, Seite 497
1. Verfasser: Grünwald, Peter D. (VerfasserIn)
Weitere Verfasser: Vitányi, Paul M. B.
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2003
Zugriff auf das übergeordnete Werk:Journal of Logic, Language, and Information
Schlagworte:Algorithmic information theory data compression Kolmogorov complexity mutual information prefix codes rate distortion theory Shannon information theory universal codes Mathematics Physical sciences mehr... Linguistics Information science Applied sciences