Kolmogorov Complexity and Information Theory: With an Interpretation in Terms of Questions and Answers

Kolmogorov Complexity and Information Theory: With an Interpretation in Terms of Questions and Answers

We compare the elementary theories of Shannon information and Kolmogorov complexity, the extent to which they have a common purpose, and where they are fundamentally different. We discuss and relate the basic notions of both theories: Shannon entropy, Kolmogorov complexity, Shannon mutual informatio...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:Journal of Logic, Language, and Information. - Springer Science + Business Media. - 12(2003), 4, Seite 497
1. Verfasser: Grünwald, Peter D. (VerfasserIn)
Weitere Verfasser: Vitányi, Paul M. B.
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2003
Zugriff auf das übergeordnete Werk:Journal of Logic, Language, and Information
Schlagworte:Algorithmic information theory data compression Kolmogorov complexity mutual information prefix codes rate distortion theory Shannon information theory universal codes Mathematics Physical sciences mehr... Linguistics Information science Applied sciences
LEADER 01000caa a22002652 4500
001 JST049602586
003 DE-627
005 20240621165441.0
007 cr uuu---uuuuu
008 150324s2003 xx |||||o 00| ||eng c
035 |a (DE-627)JST049602586 
035 |a (JST)40167357 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Grünwald, Peter D.  |e verfasserin  |4 aut 
245 1 0 |a Kolmogorov Complexity and Information Theory: With an Interpretation in Terms of Questions and Answers 
264 1 |c 2003 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
520 |a We compare the elementary theories of Shannon information and Kolmogorov complexity, the extent to which they have a common purpose, and where they are fundamentally different. We discuss and relate the basic notions of both theories: Shannon entropy, Kolmogorov complexity, Shannon mutual information and Kolmogorov ("algorithmic") mutual information. We explain how universal coding may be viewed as a middle ground between the two theories. We consider Shannon's rate distortion theory, which quantifies useful (in a certain sense) information. We use the communication of information as our guiding motif, and we explain how it relates to sequential question-answer sessions. 
540 |a Copyright 2003 Kluwer Academic Publishers 
650 4 |a Algorithmic information theory 
650 4 |a data compression 
650 4 |a Kolmogorov complexity 
650 4 |a mutual information 
650 4 |a prefix codes 
650 4 |a rate distortion theory 
650 4 |a Shannon information theory 
650 4 |a universal codes 
650 4 |a Mathematics  |x Applied mathematics  |x Information theory 
650 4 |a Physical sciences  |x Physics  |x Thermodynamics  |x Thermodynamic properties  |x Entropy 
650 4 |a Linguistics  |x Language  |x Orthographies  |x Cryptography  |x Decryption 
650 4 |a Information science  |x Coding theory 
650 4 |a Mathematics  |x Pure mathematics  |x Probability theory  |x Random variables 
650 4 |a Mathematics  |x Applied mathematics  |x Statistics  |x Applied statistics  |x Descriptive statistics  |x Statistical distributions  |x Distribution functions  |x Probability distributions 
650 4 |a Linguistics  |x Language  |x Lexicology  |x Words 
650 4 |a Applied sciences  |x Computer science  |x Computer logic  |x Binary codes 
650 4 |a Mathematics  |x Pure mathematics  |x Discrete mathematics  |x Number theory  |x Numbers  |x Real numbers  |x Rational numbers  |x Integers  |x Natural numbers 
650 4 |a Mathematics  |x Mathematical expressions  |x Mathematical functions 
655 4 |a research-article 
700 1 |a Vitányi, Paul M. B.  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t Journal of Logic, Language, and Information  |d Springer Science + Business Media  |g 12(2003), 4, Seite 497  |w (DE-627)26953914X  |w (DE-600)1475526-9  |x 15729583  |7 nnns 
773 1 8 |g volume:12  |g year:2003  |g number:4  |g pages:497 
856 4 0 |u https://www.jstor.org/stable/40167357  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_JST 
912 |a GBV_ILN_11 
912 |a GBV_ILN_20 
912 |a GBV_ILN_22 
912 |a GBV_ILN_23 
912 |a GBV_ILN_24 
912 |a GBV_ILN_31 
912 |a GBV_ILN_32 
912 |a GBV_ILN_39 
912 |a GBV_ILN_40 
912 |a GBV_ILN_60 
912 |a GBV_ILN_62 
912 |a GBV_ILN_63 
912 |a GBV_ILN_69 
912 |a GBV_ILN_70 
912 |a GBV_ILN_73 
912 |a GBV_ILN_74 
912 |a GBV_ILN_90 
912 |a GBV_ILN_95 
912 |a GBV_ILN_100 
912 |a GBV_ILN_101 
912 |a GBV_ILN_105 
912 |a GBV_ILN_110 
912 |a GBV_ILN_120 
912 |a GBV_ILN_138 
912 |a GBV_ILN_150 
912 |a GBV_ILN_151 
912 |a GBV_ILN_152 
912 |a GBV_ILN_161 
912 |a GBV_ILN_170 
912 |a GBV_ILN_171 
912 |a GBV_ILN_187 
912 |a GBV_ILN_213 
912 |a GBV_ILN_224 
912 |a GBV_ILN_230 
912 |a GBV_ILN_250 
912 |a GBV_ILN_281 
912 |a GBV_ILN_285 
912 |a GBV_ILN_293 
912 |a GBV_ILN_370 
912 |a GBV_ILN_374 
912 |a GBV_ILN_602 
912 |a GBV_ILN_636 
912 |a GBV_ILN_702 
912 |a GBV_ILN_2001 
912 |a GBV_ILN_2003 
912 |a GBV_ILN_2004 
912 |a GBV_ILN_2005 
912 |a GBV_ILN_2006 
912 |a GBV_ILN_2007 
912 |a GBV_ILN_2008 
912 |a GBV_ILN_2009 
912 |a GBV_ILN_2010 
912 |a GBV_ILN_2011 
912 |a GBV_ILN_2014 
912 |a GBV_ILN_2015 
912 |a GBV_ILN_2018 
912 |a GBV_ILN_2020 
912 |a GBV_ILN_2021 
912 |a GBV_ILN_2025 
912 |a GBV_ILN_2026 
912 |a GBV_ILN_2027 
912 |a GBV_ILN_2031 
912 |a GBV_ILN_2034 
912 |a GBV_ILN_2037 
912 |a GBV_ILN_2038 
912 |a GBV_ILN_2039 
912 |a GBV_ILN_2044 
912 |a GBV_ILN_2048 
912 |a GBV_ILN_2049 
912 |a GBV_ILN_2050 
912 |a GBV_ILN_2055 
912 |a GBV_ILN_2056 
912 |a GBV_ILN_2057 
912 |a GBV_ILN_2059 
912 |a GBV_ILN_2061 
912 |a GBV_ILN_2064 
912 |a GBV_ILN_2065 
912 |a GBV_ILN_2068 
912 |a GBV_ILN_2070 
912 |a GBV_ILN_2086 
912 |a GBV_ILN_2088 
912 |a GBV_ILN_2093 
912 |a GBV_ILN_2106 
912 |a GBV_ILN_2107 
912 |a GBV_ILN_2108 
912 |a GBV_ILN_2110 
912 |a GBV_ILN_2111 
912 |a GBV_ILN_2112 
912 |a GBV_ILN_2113 
912 |a GBV_ILN_2116 
912 |a GBV_ILN_2118 
912 |a GBV_ILN_2119 
912 |a GBV_ILN_2122 
912 |a GBV_ILN_2129 
912 |a GBV_ILN_2143 
912 |a GBV_ILN_2144 
912 |a GBV_ILN_2147 
912 |a GBV_ILN_2148 
912 |a GBV_ILN_2152 
912 |a GBV_ILN_2153 
912 |a GBV_ILN_2188 
912 |a GBV_ILN_2190 
912 |a GBV_ILN_2232 
912 |a GBV_ILN_2336 
912 |a GBV_ILN_2446 
912 |a GBV_ILN_2470 
912 |a GBV_ILN_2472 
912 |a GBV_ILN_2507 
912 |a GBV_ILN_2522 
912 |a GBV_ILN_2548 
912 |a GBV_ILN_2937 
912 |a GBV_ILN_2949 
912 |a GBV_ILN_2950 
912 |a GBV_ILN_4012 
912 |a GBV_ILN_4035 
912 |a GBV_ILN_4037 
912 |a GBV_ILN_4046 
912 |a GBV_ILN_4112 
912 |a GBV_ILN_4125 
912 |a GBV_ILN_4126 
912 |a GBV_ILN_4242 
912 |a GBV_ILN_4246 
912 |a GBV_ILN_4249 
912 |a GBV_ILN_4251 
912 |a GBV_ILN_4305 
912 |a GBV_ILN_4306 
912 |a GBV_ILN_4307 
912 |a GBV_ILN_4313 
912 |a GBV_ILN_4322 
912 |a GBV_ILN_4323 
912 |a GBV_ILN_4324 
912 |a GBV_ILN_4325 
912 |a GBV_ILN_4326 
912 |a GBV_ILN_4328 
912 |a GBV_ILN_4333 
912 |a GBV_ILN_4334 
912 |a GBV_ILN_4335 
912 |a GBV_ILN_4336 
912 |a GBV_ILN_4338 
912 |a GBV_ILN_4346 
912 |a GBV_ILN_4393 
912 |a GBV_ILN_4700 
951 |a AR 
952 |d 12  |j 2003  |e 4  |h 497