✦ LIBER ✦

A note on Kolmogorov complexity and entropy

✍ Scribed by Yasuichi Horibe

Publisher: Elsevier Science
Year: 2003
Tongue: English
Weight: 105 KB
Volume: 16
Category: Article
ISSN: 0893-9659
DOI: 10.1016/s0893-9659(03)90105-4

No coin nor oath required. For personal study only.

📜 SIMILAR VOLUMES

Inequalities for Shannon Entropy and Kol

Inequalities for Shannon Entropy and Kolmogorov Complexity

✍ Daniel Hammer; Andrei Romashchenko; Alexander Shen; Nikolai Vereshchagin 📂 Article 📅 2000 🏛 Elsevier Science 🌐 English ⚖ 272 KB

It was mentioned by Kolmogorov (1968, IEEE Trans. Inform. Theory 14, 662 664) that the properties of algorithmic complexity and Shannon entropy are similar. We investigate one aspect of this similarity. Namely, we are interested in linear inequalities that are valid for Shannon entropy and for Kolmo

A note on the Kolmogorov data complexity

A note on the Kolmogorov data complexity and nonuniform logical definitions

✍ Jerzy Tyszkiewicz 📂 Article 📅 1997 🏛 Elsevier Science 🌐 English ⚖ 773 KB

We define a new Kolmogorov complexity based measure of complexity of logics. Then we use this new tool to prove a sharp estimate of the length of first order sentences defining nonuniformly more complicated Lindstrijm quantifiers in terms of simpler ones. @ 1997 Published by Elsevier Science B.V.

A note on a Kolmogorov inequality

✍ Dean M Young; John W Seaman Jr.; Virgil R Marco 📂 Article 📅 1987 🏛 Elsevier Science 🌐 English ⚖ 59 KB

Using Shannon entropy and Kolmogorov com

Using Shannon entropy and Kolmogorov complexity to study the communicative system and cognitive capacities in ants

✍ Boris Ryabko; Zhanna Reznikova 📂 Article 📅 1996 🏛 John Wiley and Sons 🌐 English ⚖ 89 KB

A note on conditional logics and entropy

✍ Gabriele Kern-Isberner 📂 Article 📅 1998 🏛 Elsevier Science 🌐 English ⚖ 745 KB

The principles of maximum entropy and of minimum cross-entropy (ME-principles) provide an elegant and reasonable tool to represent quantified uncertainties within a probabilistic framework. The results the application of these principles yield are not only well behaved in a statistical sense but pro

A note on bounded entropies

✍ Pierre-Olivier Amblard; Christophe Vignat 📂 Article 📅 2006 🏛 Elsevier Science 🌐 English ⚖ 134 KB