Novelty, information and surprise:
Saved in:
| Main Author: | |
|---|---|
| Format: | Book |
| Language: | English |
| Published: |
Heidelberg [u.a.]
Springer
2012
|
| Subjects: | |
| Online Access: | Inhaltsverzeichnis |
| Physical Description: | XXIII, 248 S. graph. Darst. |
| ISBN: | 9783642290749 |
Staff View
MARC
| LEADER | 00000nam a2200000zc 4500 | ||
|---|---|---|---|
| 001 | BV041751076 | ||
| 003 | DE-604 | ||
| 005 | 20141121 | ||
| 007 | t | ||
| 008 | 140322s2012 d||| |||| 00||| eng d | ||
| 015 | |a 12,O09 |2 dnb | ||
| 020 | |a 9783642290749 |9 978-3-642-29074-9 | ||
| 024 | 3 | |a 9783642290756 | |
| 035 | |a (OCoLC)812569515 | ||
| 035 | |a (DE-599)BVBBV041751076 | ||
| 040 | |a DE-604 |b ger |e rakddb | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-11 |a DE-188 |a DE-12 | ||
| 084 | |a SK 830 |0 (DE-625)143259: |2 rvk | ||
| 084 | |a 24,1 |2 ssgn | ||
| 084 | |a 620 |2 sdnb | ||
| 100 | 1 | |a Palm, Günther |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Novelty, information and surprise |c Günther Palm |
| 264 | 1 | |a Heidelberg [u.a.] |b Springer |c 2012 | |
| 300 | |a XXIII, 248 S. |b graph. Darst. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 650 | 0 | 7 | |a Überraschung |0 (DE-588)4240825-8 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Innovation |0 (DE-588)4027089-0 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Informationstheorie |0 (DE-588)4026927-9 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Informationsverarbeitung |0 (DE-588)4161678-9 |2 gnd |9 rswk-swf |
| 653 | |a Information theory | ||
| 689 | 0 | 0 | |a Informationstheorie |0 (DE-588)4026927-9 |D s |
| 689 | 0 | |5 DE-604 | |
| 689 | 1 | 0 | |a Informationsverarbeitung |0 (DE-588)4161678-9 |D s |
| 689 | 1 | 1 | |a Überraschung |0 (DE-588)4240825-8 |D s |
| 689 | 1 | 2 | |a Innovation |0 (DE-588)4027089-0 |D s |
| 689 | 1 | |5 DE-604 | |
| 776 | 0 | 8 | |i Erscheint auch als |n Online-Ausgabe |z 978-3-642-29075-6 |
| 856 | 4 | 2 | |m Digitalisierung BSB Muenchen - ADAM Catalogue Enrichment |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=027197450&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-027197450 | ||
| 942 | 1 | 1 | |c 004 |e 22/bsb |
| 942 | 1 | 1 | |c 658.4038 |e 22/bsb |
Record in the Search Index
| _version_ | 1804152049148887040 |
|---|---|
| adam_text | Contents
Introduction
...................................................................... xiii
References
.................................................................... xxii
Part I Surprise and Information of Descriptions
1
Prerequisites from Logic and Probability Theory
...................... 3
1.1
Logic and Probability of Propositions
............................... 3
1.2
Mappings, Functions and Random Variables
....................... 5
1.3
Measurability, Random Variables, and Expectation Value
......... 7
1.4
Technical Comments
................................................. 10
References
.................................................................... 10
2
Improbability and Novelty of Descriptions
.............................. 11
2.1
Introductory Examples
............................................... 11
2.2
Definition and Properties
............................................. 14
2.3
Descriptions
.......................................................... 15
2.4
Properties of Descriptions
........................................... 18
2.5
Information and Surprise of Descriptions
........................... 24
2.6
Information and Surprise of a Random Variable
.................... 30
2.7
Technical Comments
................................................. 31
2.8
Exercises
.............................................................. 32
References
.................................................................... 34
3
Conditional and Subjective Novelty and Information
.................. 35
3.1
Introductory Examples
............................................... 35
3.2
Subjective Novelty
................................................... 36
3.3
Conditional Novelty
.................................................. 38
3.4
Information Theory for Random Variables
......................... 42
3.5
Technical Comments
................................................. 44
3.6
Exercises
.............................................................. 45
References
.................................................................... 46
vi
Contents
Part II Coding and Information Transmission
4
On Guessing and Coding
.................................................. 51
4.1
Introductory Examples
............................................... 51
4.2
Guessing Strategies
.................................................. 53
4.3
Codes and Their Relation to Guessing Strategies
................... 54
4.4
Kraft s Theorem
...................................................... 56
4.5
Huffman Codes
....................................................... 57
4.6
Relation Between Codewordlength and Information
............... 58
4.7
Technical Comments
................................................. 60
4.8
Exercises
.............................................................. 60
References
.................................................................... 62
5
Information Transmission
................................................. 63
5.1
Introductory Examples
............................................... 63
5.2
Transition Probability
................................................ 65
5.3
Transmission of Information Across Simple Channels
............. 67
5.4
Technical Comments
................................................. 71
5.5
Exercises
.............................................................. 72
Reference
..................................................................... 74
Part III Information Rate and Channel Capacity
6
Stationary Processes and Their Information Rate
...................... 77
6.1
Introductory Examples
............................................... 77
6.2
Definition and Properties of Stochastic Processes
.................. 78
6.3
The Weak Law of Large Numbers
................................... 80
6.4
Information Rate of Stationary Processes
........................... 81
6.5 Transinformation Rate............................................... 84
6.6
Asymptotic Equipartition Property
.................................. 85
6.7
Technical Comments
................................................. 87
6.8
Exercises
.............................................................. 87
References
.....................,.............................................. 88
7
Channel Capacity
........................................................... 89
7.1
Information Channels
................................................ 89
7.2
Memory and Anticipation
............................................ 90
7.3
Channel Capacity
..................................................... 91
7.4
Technical Comments
................................................. 94
7.5
Exercises
.............................................................. 94
References
.................................................................... 95
8
How to Transmit Information Reliably with Unreliable
Elements (Shannon s Theorem)
........................................... 97
8.1
The Problem of Adapting a Source to a Channel
................... 97
8.2
Shannon s Theorem
.................................................. 98
Contents
vii
8.3 Technical
Comments
................................................. 101
8.4
Exercises
.............................................................. 101
References
.................................................................... 101
Part IV Repertoires and Covers
9
Repertoires and Descriptions
.............................................. 105
9.1
Introductory Examples
............................................... 106
9.2
Repertoires and Their Relation to Descriptions
..................... 109
9.3
Tight Repertoires
..................................................... 115
9.4
Narrow and Shallow Covers
......................................... 117
9.5
Technical Comments
................................................. 119
9.6
Exercises
.............................................................. 120
References
.................................................................... 120
10
Novelty, Information and Surprise of Repertoires
...................... 123
10.1
Introductory Examples
............................................... 123
10.2
Definitions and Properties
........................................... 125
10.3
Finding Descriptions with Minimal Information
................... 133
10.4
Technical Comments
................................................. 138
10.5
Exercises
.............................................................. 138
References
.................................................................... 139
11
Conditioning, Mutual Information, and Information Gain
............ 141
11.1
Introductory Examples
............................................... 141
11.2
Conditional Information and Mutual Information
.................. 142
11.3
Information Gain, Novelty Gain, and Surprise Loss
................ 146
11.4
Conditional Information of Continuous Random Variables
........ 152
11.5
Technical Comments
................................................. 154
11.6
Applications in Pattern Recognition,
Machine Learning, and Life-Science
................................ 155
11.7
Exercises
.............................................................. 156
References
.................................................................... 157
Part V Information, Novelty and Surprise in Science
12
Information, Novelty, and Surprise in Brain Theory
................... 161
12.1
Understanding Brains in Terms of Processing
and Transmission of Information
.................................... 161
12.2
Neural Repertoires
................................................... 166
12.3
Experimental Repertoires in
Neuroscience
......................... 167
12.3.1
The Burst Repertoire
....................................... 168
12.3.2
The Pause Repertoire
....................................... 170
12.3.3
The Coincidence Repertoire
............................... 170
12.3.4
The Depolarization Repertoire
............................. 173
12.4
Neural Population Repertoires: Semantics and Syntax
............. 173
viii Contents
12.5
Conclusion
............................................................ 175
12.6 Technical
Comments
................................................. 175
12.6.1
Coincidence
................................................. 179
12.6.2
Coincidental Patterns
....................................... 179
12.6.3
Spatio-Temporal
Patterns
................................... 179
References
.................................................................... 181
13
Surprise from Repetitions and Combination of Surprises
............. 189
13.1
Combination of Surprises
............................................ 189
13.2
Surprise of Repetitions
............................................... 191
13.3
Technical Comments
................................................. 194
References
.................................................................... 194
14
Entropy in Physics
.......................................................... 195
14.1
Classical Entropy
..................................................... 195
14.2
Modern Entropies and the Second Law
............................. 198
14.3
The Second Law in Terms of Information Gain
.................... 201
14.4
Technical Comments
................................................. 204
References
.................................................................... 204
Part VI Generalized Information Theory
15
Order- and Lattice-Structures
............................................ 207
15.1
Definitions and Properties
........................................... 207
15.2
The Lattice V of Descriptions
....................................... 213
15.3
Technical Comments
................................................. 214
Reference
..................................................................... 215
16
Three
Ordermgs
on Repertoires
.......................................... 217
16.1
Definition and Basic Properties
...................................... 217
16.2
Equivalence Relations Defined by the
Orderings
................... 220
16.3
The Joins and Meets for the
Orderings
.............................. 222
16.4
The
Orderings
on Templates and Flat Covers
....................... 226
16.5
Technical Comments
................................................. 227
16.6
Exercises
.............................................................. 228
References
.................................................................... 228
17
Information Theory on Lattices of Covers
............................... 229
17.1
The Lattice <t of Covers
.............................................. 229
17.2
The Lattice 3> of Finite Flat Covers
................................ 231
17.3
The Lattice
ÍK
of (Clean) Repertoires
............................... 232
17.4
The Lattice
T
of Templates
.......................................... 233
17.5
The Lattice
φ
of Partitions
.......................................... 234
17.6
Technical Comments
................................................. 235
17.7
Exercises
.............................................................. 235
References
.................................................................... 235
L.
Contents ix
Appendices
A Fuzzy Repertoires and Descriptions
...................................... 237
A.
1
Basic Definitions
..................................................... 238
A.2 Definition and Properties of Fuzzy Repertoires
..................... 240
Reference
..................................................................... 242
Glossary
........................................................................... 243
Index
............................................................................... 245
|
| any_adam_object | 1 |
| author | Palm, Günther |
| author_facet | Palm, Günther |
| author_role | aut |
| author_sort | Palm, Günther |
| author_variant | g p gp |
| building | Verbundindex |
| bvnumber | BV041751076 |
| classification_rvk | SK 830 |
| ctrlnum | (OCoLC)812569515 (DE-599)BVBBV041751076 |
| discipline | Maschinenbau / Maschinenwesen Mathematik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01873nam a2200493zc 4500</leader><controlfield tag="001">BV041751076</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20141121 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">140322s2012 d||| |||| 00||| eng d</controlfield><datafield tag="015" ind1=" " ind2=" "><subfield code="a">12,O09</subfield><subfield code="2">dnb</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9783642290749</subfield><subfield code="9">978-3-642-29074-9</subfield></datafield><datafield tag="024" ind1="3" ind2=" "><subfield code="a">9783642290756</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)812569515</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV041751076</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakddb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-11</subfield><subfield code="a">DE-188</subfield><subfield code="a">DE-12</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">SK 830</subfield><subfield code="0">(DE-625)143259:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">24,1</subfield><subfield code="2">ssgn</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">620</subfield><subfield code="2">sdnb</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Palm, Günther</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Novelty, information and surprise</subfield><subfield code="c">Günther Palm</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Heidelberg [u.a.]</subfield><subfield code="b">Springer</subfield><subfield code="c">2012</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XXIII, 248 S.</subfield><subfield code="b">graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Überraschung</subfield><subfield code="0">(DE-588)4240825-8</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Innovation</subfield><subfield code="0">(DE-588)4027089-0</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Informationstheorie</subfield><subfield code="0">(DE-588)4026927-9</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Informationsverarbeitung</subfield><subfield code="0">(DE-588)4161678-9</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="653" ind1=" " ind2=" "><subfield code="a">Information theory</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Informationstheorie</subfield><subfield code="0">(DE-588)4026927-9</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="689" ind1="1" ind2="0"><subfield code="a">Informationsverarbeitung</subfield><subfield code="0">(DE-588)4161678-9</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2="1"><subfield code="a">Überraschung</subfield><subfield code="0">(DE-588)4240825-8</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2="2"><subfield code="a">Innovation</subfield><subfield code="0">(DE-588)4027089-0</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Online-Ausgabe</subfield><subfield code="z">978-3-642-29075-6</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung BSB Muenchen - ADAM Catalogue Enrichment</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=027197450&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-027197450</subfield></datafield><datafield tag="942" ind1="1" ind2="1"><subfield code="c">004</subfield><subfield code="e">22/bsb</subfield></datafield><datafield tag="942" ind1="1" ind2="1"><subfield code="c">658.4038</subfield><subfield code="e">22/bsb</subfield></datafield></record></collection> |
| id | DE-604.BV041751076 |
| illustrated | Illustrated |
| indexdate | 2024-07-10T01:04:32Z |
| institution | BVB |
| isbn | 9783642290749 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-027197450 |
| oclc_num | 812569515 |
| open_access_boolean | |
| owner | DE-11 DE-188 DE-12 |
| owner_facet | DE-11 DE-188 DE-12 |
| physical | XXIII, 248 S. graph. Darst. |
| publishDate | 2012 |
| publishDateSearch | 2012 |
| publishDateSort | 2012 |
| publisher | Springer |
| record_format | marc |
| spelling | Palm, Günther Verfasser aut Novelty, information and surprise Günther Palm Heidelberg [u.a.] Springer 2012 XXIII, 248 S. graph. Darst. txt rdacontent n rdamedia nc rdacarrier Überraschung (DE-588)4240825-8 gnd rswk-swf Innovation (DE-588)4027089-0 gnd rswk-swf Informationstheorie (DE-588)4026927-9 gnd rswk-swf Informationsverarbeitung (DE-588)4161678-9 gnd rswk-swf Information theory Informationstheorie (DE-588)4026927-9 s DE-604 Informationsverarbeitung (DE-588)4161678-9 s Überraschung (DE-588)4240825-8 s Innovation (DE-588)4027089-0 s Erscheint auch als Online-Ausgabe 978-3-642-29075-6 Digitalisierung BSB Muenchen - ADAM Catalogue Enrichment application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=027197450&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Palm, Günther Novelty, information and surprise Überraschung (DE-588)4240825-8 gnd Innovation (DE-588)4027089-0 gnd Informationstheorie (DE-588)4026927-9 gnd Informationsverarbeitung (DE-588)4161678-9 gnd |
| subject_GND | (DE-588)4240825-8 (DE-588)4027089-0 (DE-588)4026927-9 (DE-588)4161678-9 |
| title | Novelty, information and surprise |
| title_auth | Novelty, information and surprise |
| title_exact_search | Novelty, information and surprise |
| title_full | Novelty, information and surprise Günther Palm |
| title_fullStr | Novelty, information and surprise Günther Palm |
| title_full_unstemmed | Novelty, information and surprise Günther Palm |
| title_short | Novelty, information and surprise |
| title_sort | novelty information and surprise |
| topic | Überraschung (DE-588)4240825-8 gnd Innovation (DE-588)4027089-0 gnd Informationstheorie (DE-588)4026927-9 gnd Informationsverarbeitung (DE-588)4161678-9 gnd |
| topic_facet | Überraschung Innovation Informationstheorie Informationsverarbeitung |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=027197450&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT palmgunther noveltyinformationandsurprise |