|
one of the largest directories of the web |
|
Home : Science : Math : Applications : Information Theory
Information Theory
Encyclopedia Britannica's says that "the chief concern of information theory is to discover mathematical laws governing systems designed to communicate or manipulate information. It sets up quantitative measures of information and of the capacity of various systems to transmit, store, and otherwise process information. Some of the problems treated are related to finding the best methods of
using various available communication systems and the best methods for separating the wanted information, or signal, from the extraneous information, or noise".
The study of information theory is also concerned with the definition of notion of information in a
general sense and with a unified information theory that is supposed to contain all the statements of existing information theories.
using various available communication systems and the best methods for separating the wanted information, or signal, from the extraneous information, or noise".
The study of information theory is also concerned with the definition of notion of information in a
general sense and with a unified information theory that is supposed to contain all the statements of existing information theories.
Sites in Information Theory
Information Theory Resources
Small collection of links about Information Theory and Claude Shannon.
Quantum Information Theory
A presentation at the undergraduate level by Michael Gibbs.
Self-Organizing Systems (SOS) FAQ
Includes a very extensive catalog of links on SOS.
Linear Complexity: A Literature Survey
The linear complexity (LC) of a sequence is the size in bits of the shortest linear feedback shift register (LFSR) which can produce that sequence. The measure speaks to the difficulty of generating, and perhaps analyzing, a particular sequence.
Entropy in Information Theory
A collection of links to on-line expository articles on entropy and theory of information, maintained by Roland Gunesch (Penn State).
The Classic Definition of Information
From the Web Dictionary of Cybernetics and Systems.
Organs of Computation
A Talk With Steven Pinker.
Biosemiotics
A comprehensive site dedicated to biosemiotics, an interdisciplinary science that studies communication and signification in living systems.
Entropy on the World Wide Web
To promote the appreciation, understanding, and applications of entropy in its many forms.
Information Theory
A basic introduction and history of information theory from Bell Labs.
Introduction To Algorithmic Information Theory
An introduction to the synthesis of computation and information theory by Nick Szabo.
Basics of Information Theory
A brief introduction to information theory by David S. Touretzky of Carnegie Mellon University.
Rip Claude Shannon
Tells about the inventor's discovery of the binary system for transmitting information. Also, discusses work with artificial intelligence. Includes resource links.
A Short Course in Information Theory
Eight lectures on information theory by David MacKay.
Algorithmic Information Theory
Open problems and links to software.
Information Theory and music
An article about Information Theory and music. Definition of Information Theory, Probability, Markov Chains.
A Discipline Independent Definition of Information
An article about some sides of Information Theory written by Robert M. Losee. Also there is link to pdf-version of article.
Information Theory
Site promotes activities in the areas of information and communications theory in Australia. Information about conferences and other such stuff.
Information theory briefly
Introduction to Information Theory: defenition of information, efficient encoding, variable length codes. |
|
||
sub categories in Information Theory
|
|||
cross references
other references
