Probability and information: an integrated approach
Saved in:
| Main Author: | |
|---|---|
| Format: | Book |
| Language: | English |
| Published: |
Cambridge
Cambridge University Press
2008
|
| Edition: | second edition |
| Subjects: | |
| Online Access: | Inhaltsverzeichnis |
| Physical Description: | xvi, 273 Seiten Diagramme |
| ISBN: | 9780521727884 9780521899048 |
Staff View
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV023342450 | ||
| 003 | DE-604 | ||
| 005 | 20230815 | ||
| 007 | t | ||
| 008 | 080612s2008 |||| |||| 00||| eng d | ||
| 020 | |a 9780521727884 |9 978-0-521-72788-4 | ||
| 020 | |a 9780521899048 |9 978-0-521-89904-8 | ||
| 035 | |a (OCoLC)610966539 | ||
| 035 | |a (DE-599)BVBBV023342450 | ||
| 040 | |a DE-604 |b ger |e rda | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-20 |a DE-29T |a DE-824 |a DE-11 |a DE-355 |a DE-91G |a DE-83 | ||
| 050 | 0 | |a QA273 A66 2008 | |
| 082 | 0 | |a 519 |2 22 | |
| 084 | |a SK 800 |0 (DE-625)143256: |2 rvk | ||
| 084 | |a ST 600 |0 (DE-625)143681: |2 rvk | ||
| 084 | |a MAT 600f |2 stub | ||
| 084 | |a DAT 570f |2 stub | ||
| 084 | |a 94A17 |2 msc | ||
| 084 | |a 60-01 |2 msc | ||
| 084 | |a 94-01 |2 msc | ||
| 100 | 1 | |a Applebaum, David |d 1956- |0 (DE-588)136277659 |4 aut | |
| 245 | 1 | 0 | |a Probability and information |b an integrated approach |c David Applebaum |
| 250 | |a second edition | ||
| 264 | 1 | |a Cambridge |b Cambridge University Press |c 2008 | |
| 300 | |a xvi, 273 Seiten |b Diagramme | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 650 | 7 | |a Information, Théorie de l' |2 ram | |
| 650 | 4 | |a Probabilités | |
| 650 | 7 | |a Probabilités |2 ram | |
| 650 | 4 | |a Théorie de l'information | |
| 650 | 4 | |a Information theory | |
| 650 | 4 | |a Probabilities | |
| 650 | 0 | 7 | |a Informationstheorie |0 (DE-588)4026927-9 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Wahrscheinlichkeitsrechnung |0 (DE-588)4064324-4 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Wahrscheinlichkeitstheorie |0 (DE-588)4079013-7 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Wahrscheinlichkeitsrechnung |0 (DE-588)4064324-4 |D s |
| 689 | 0 | |5 DE-604 | |
| 689 | 1 | 0 | |a Wahrscheinlichkeitstheorie |0 (DE-588)4079013-7 |D s |
| 689 | 1 | 1 | |a Informationstheorie |0 (DE-588)4026927-9 |D s |
| 689 | 1 | |8 1\p |5 DE-604 | |
| 856 | 4 | 2 | |m HBZ Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=016526193&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-016526193 | ||
| 883 | 1 | |8 1\p |a cgwrk |d 20201028 |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | |
Record in the Search Index
| _version_ | 1804137695991037952 |
|---|---|
| adam_text | Contents
Preface to the second edition page xi
Preface to the first edition xiii
1 Introduction 1
1.1 Chance and information 1
1.2 Mathematical models of chance phenomena 2
1.3 Mathematical structure and mathematical proof 5
1.4 Plan of this book 7
2 Combinatorics 10
2.1 Counting 10
2.2 Arrangements 11
2.3 Combinations 13
2.4 Multinomial coefficients 16
2.5 The gamma function 18
Exercises 19
Further reading 21
3 Sets and measures 22
3.1 The concept of a set 22
3.2 Set operations 25
3.3 Boolean algebras 29
3.4 Measures on Boolean algebras 32
Exercises 37
Further reading 40
4 Probability 41
4.1 The concept of probability 41
4.2 Probability in practice 43
vn
viii Contents
4.3 Conditional probability 48
4.4 Independence 55
4.5 The interpretation of probability 57
4.6 The historical roots of probability 62
Exercises 64
Further reading 68
5 Discrete random variables 70
5.1 The concept of a random variable 70
5.2 Properties of random variables 72
5.3 Expectation and variance 78
5.4 Covariance and correlation 83
5.5 Independent random variables 86
5.6 I.I.D. random variables 89
5.7 Binomial and Poisson random variables 91
5.8 Geometric, negative binomial and hypergeometric
random variables 95
Exercises 99
Further reading 104
6 Information and entropy 105
6.1 What is information? 105
6.2 Entropy 108
6.3 Joint and conditional entropies; mutual information 111
6.4 The maximum entropy principle 115
6.5 Entropy, physics and life 117
6.6 The uniqueness of entropy 119
Exercises 123
Further reading 125
7 Communication 127
7.1 Transmission of information 127
7.2 The channel capacity 130
7.3 Codes 132
7.4 Noiseless coding 137
7.5 Coding and transmission with noise - Shannon s
theorem 143
7.6 Brief remarks about the history of information theory 150
Exercises 151
Further reading 153
Contents ix
8 Random variables with probability density functions 155
8.1 Random variables with continuous ranges 155
8.2 Probability density functions 157
8.3 Discretisation and integration 161
8.4 Laws of large numbers 164
8.5 Normal random variables 167
8.6 The central limit theorem 172
8.7 Entropy in the continuous case 179
Exercises 182
Further reading 186
9 Random vectors 188
9.1 Cartesian products 188
9.2 Boolean algebras and measures on products 191
9.3 Distributions of random vectors 193
9.4 Marginal distributions 199
9.5 Independence revisited 201
9.6 Conditional densities and conditional entropy 204
9.7 Mutual information and channel capacity 208
Exercises 212
Further reading 216
10 Markov chains and their entropy 217
10.1 Stochastic processes 217
10.2 Markov chains 219
10.3 The Chapman-Kolmogorov equations 224
10.4 Stationary processes 227
10.5 Invariant distributions and stationary Markov chains 229
10.6 Entropy rates for Markov chains 235
Exercises 240
Further reading 243
Exploring further 245
Appendix 1 Proof by mathematical induction 247
Appendix 2 Lagrange multipliers 249
Appendix 3 Integration of exp (— ^jc2) 252
Appendix 4 Table of probabilities associated with the standard
normal distribution 254
Appendix 5 A rapid review of matrix algebra 256
Selected solutions 260
Index 268
|
| adam_txt |
Contents
Preface to the second edition page xi
Preface to the first edition xiii
1 Introduction 1
1.1 Chance and information 1
1.2 Mathematical models of chance phenomena 2
1.3 Mathematical structure and mathematical proof 5
1.4 Plan of this book 7
2 Combinatorics 10
2.1 Counting 10
2.2 Arrangements 11
2.3 Combinations 13
2.4 Multinomial coefficients 16
2.5 The gamma function 18
Exercises 19
Further reading 21
3 Sets and measures 22
3.1 The concept of a set 22
3.2 Set operations 25
3.3 Boolean algebras 29
3.4 Measures on Boolean algebras 32
Exercises 37
Further reading 40
4 Probability 41
4.1 The concept of probability 41
4.2 Probability in practice 43
vn
viii Contents
4.3 Conditional probability 48
4.4 Independence 55
4.5 The interpretation of probability 57
4.6 The historical roots of probability 62
Exercises 64
Further reading 68
5 Discrete random variables 70
5.1 The concept of a random variable 70
5.2 Properties of random variables 72
5.3 Expectation and variance 78
5.4 Covariance and correlation 83
5.5 Independent random variables 86
5.6 I.I.D. random variables 89
5.7 Binomial and Poisson random variables 91
5.8 Geometric, negative binomial and hypergeometric
random variables 95
Exercises 99
Further reading 104
6 Information and entropy 105
6.1 What is information? 105
6.2 Entropy 108
6.3 Joint and conditional entropies; mutual information 111
6.4 The maximum entropy principle 115
6.5 Entropy, physics and life 117
6.6 The uniqueness of entropy 119
Exercises 123
Further reading 125
7 Communication 127
7.1 Transmission of information 127
7.2 The channel capacity 130
7.3 Codes 132
7.4 Noiseless coding 137
7.5 Coding and transmission with noise - Shannon's
theorem 143
7.6 Brief remarks about the history of information theory 150
Exercises 151
Further reading 153
Contents ix
8 Random variables with probability density functions 155
8.1 Random variables with continuous ranges 155
8.2 Probability density functions 157
8.3 Discretisation and integration 161
8.4 Laws of large numbers 164
8.5 Normal random variables 167
8.6 The central limit theorem 172
8.7 Entropy in the continuous case 179
Exercises 182
Further reading 186
9 Random vectors 188
9.1 Cartesian products 188
9.2 Boolean algebras and measures on products 191
9.3 Distributions of random vectors 193
9.4 Marginal distributions 199
9.5 Independence revisited 201
9.6 Conditional densities and conditional entropy 204
9.7 Mutual information and channel capacity 208
Exercises 212
Further reading 216
10 Markov chains and their entropy 217
10.1 Stochastic processes 217
10.2 Markov chains 219
10.3 The Chapman-Kolmogorov equations 224
10.4 Stationary processes 227
10.5 Invariant distributions and stationary Markov chains 229
10.6 Entropy rates for Markov chains 235
Exercises 240
Further reading 243
Exploring further 245
Appendix 1 Proof by mathematical induction 247
Appendix 2 Lagrange multipliers 249
Appendix 3 Integration of exp (— ^jc2) 252
Appendix 4 Table of probabilities associated with the standard
normal distribution 254
Appendix 5 A rapid review of matrix algebra 256
Selected solutions 260
Index 268 |
| any_adam_object | 1 |
| any_adam_object_boolean | 1 |
| author | Applebaum, David 1956- |
| author_GND | (DE-588)136277659 |
| author_facet | Applebaum, David 1956- |
| author_role | aut |
| author_sort | Applebaum, David 1956- |
| author_variant | d a da |
| building | Verbundindex |
| bvnumber | BV023342450 |
| callnumber-first | Q - Science |
| callnumber-label | QA273 A66 2008 |
| callnumber-raw | QA273 A66 2008 |
| callnumber-search | QA273 A66 2008 |
| callnumber-sort | QA 3273 A66 42008 |
| callnumber-subject | QA - Mathematics |
| classification_rvk | SK 800 ST 600 |
| classification_tum | MAT 600f DAT 570f |
| ctrlnum | (OCoLC)610966539 (DE-599)BVBBV023342450 |
| dewey-full | 519 |
| dewey-hundreds | 500 - Natural sciences and mathematics |
| dewey-ones | 519 - Probabilities and applied mathematics |
| dewey-raw | 519 |
| dewey-search | 519 |
| dewey-sort | 3519 |
| dewey-tens | 510 - Mathematics |
| discipline | Informatik Mathematik |
| discipline_str_mv | Informatik Mathematik |
| edition | second edition |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>02188nam a2200577 c 4500</leader><controlfield tag="001">BV023342450</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20230815 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">080612s2008 |||| |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9780521727884</subfield><subfield code="9">978-0-521-72788-4</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9780521899048</subfield><subfield code="9">978-0-521-89904-8</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)610966539</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV023342450</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rda</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-20</subfield><subfield code="a">DE-29T</subfield><subfield code="a">DE-824</subfield><subfield code="a">DE-11</subfield><subfield code="a">DE-355</subfield><subfield code="a">DE-91G</subfield><subfield code="a">DE-83</subfield></datafield><datafield tag="050" ind1=" " ind2="0"><subfield code="a">QA273 A66 2008</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">519</subfield><subfield code="2">22</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">SK 800</subfield><subfield code="0">(DE-625)143256:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 600</subfield><subfield code="0">(DE-625)143681:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">MAT 600f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">DAT 570f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">94A17</subfield><subfield code="2">msc</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">60-01</subfield><subfield code="2">msc</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">94-01</subfield><subfield code="2">msc</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Applebaum, David</subfield><subfield code="d">1956-</subfield><subfield code="0">(DE-588)136277659</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Probability and information</subfield><subfield code="b">an integrated approach</subfield><subfield code="c">David Applebaum</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">second edition</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Cambridge</subfield><subfield code="b">Cambridge University Press</subfield><subfield code="c">2008</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">xvi, 273 Seiten</subfield><subfield code="b">Diagramme</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="650" ind1=" " ind2="7"><subfield code="a">Information, Théorie de l'</subfield><subfield code="2">ram</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Probabilités</subfield></datafield><datafield tag="650" ind1=" " ind2="7"><subfield code="a">Probabilités</subfield><subfield code="2">ram</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Théorie de l'information</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Information theory</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Probabilities</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Informationstheorie</subfield><subfield code="0">(DE-588)4026927-9</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Wahrscheinlichkeitsrechnung</subfield><subfield code="0">(DE-588)4064324-4</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Wahrscheinlichkeitstheorie</subfield><subfield code="0">(DE-588)4079013-7</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Wahrscheinlichkeitsrechnung</subfield><subfield code="0">(DE-588)4064324-4</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="689" ind1="1" ind2="0"><subfield code="a">Wahrscheinlichkeitstheorie</subfield><subfield code="0">(DE-588)4079013-7</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2="1"><subfield code="a">Informationstheorie</subfield><subfield code="0">(DE-588)4026927-9</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2=" "><subfield code="8">1\p</subfield><subfield code="5">DE-604</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">HBZ Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=016526193&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-016526193</subfield></datafield><datafield tag="883" ind1="1" ind2=" "><subfield code="8">1\p</subfield><subfield code="a">cgwrk</subfield><subfield code="d">20201028</subfield><subfield code="q">DE-101</subfield><subfield code="u">https://d-nb.info/provenance/plan#cgwrk</subfield></datafield></record></collection> |
| id | DE-604.BV023342450 |
| illustrated | Not Illustrated |
| index_date | 2024-07-02T21:02:05Z |
| indexdate | 2024-07-09T21:16:23Z |
| institution | BVB |
| isbn | 9780521727884 9780521899048 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-016526193 |
| oclc_num | 610966539 |
| open_access_boolean | |
| owner | DE-20 DE-29T DE-824 DE-11 DE-355 DE-BY-UBR DE-91G DE-BY-TUM DE-83 |
| owner_facet | DE-20 DE-29T DE-824 DE-11 DE-355 DE-BY-UBR DE-91G DE-BY-TUM DE-83 |
| physical | xvi, 273 Seiten Diagramme |
| publishDate | 2008 |
| publishDateSearch | 2008 |
| publishDateSort | 2008 |
| publisher | Cambridge University Press |
| record_format | marc |
| spelling | Applebaum, David 1956- (DE-588)136277659 aut Probability and information an integrated approach David Applebaum second edition Cambridge Cambridge University Press 2008 xvi, 273 Seiten Diagramme txt rdacontent n rdamedia nc rdacarrier Information, Théorie de l' ram Probabilités Probabilités ram Théorie de l'information Information theory Probabilities Informationstheorie (DE-588)4026927-9 gnd rswk-swf Wahrscheinlichkeitsrechnung (DE-588)4064324-4 gnd rswk-swf Wahrscheinlichkeitstheorie (DE-588)4079013-7 gnd rswk-swf Wahrscheinlichkeitsrechnung (DE-588)4064324-4 s DE-604 Wahrscheinlichkeitstheorie (DE-588)4079013-7 s Informationstheorie (DE-588)4026927-9 s 1\p DE-604 HBZ Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=016526193&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis 1\p cgwrk 20201028 DE-101 https://d-nb.info/provenance/plan#cgwrk |
| spellingShingle | Applebaum, David 1956- Probability and information an integrated approach Information, Théorie de l' ram Probabilités Probabilités ram Théorie de l'information Information theory Probabilities Informationstheorie (DE-588)4026927-9 gnd Wahrscheinlichkeitsrechnung (DE-588)4064324-4 gnd Wahrscheinlichkeitstheorie (DE-588)4079013-7 gnd |
| subject_GND | (DE-588)4026927-9 (DE-588)4064324-4 (DE-588)4079013-7 |
| title | Probability and information an integrated approach |
| title_auth | Probability and information an integrated approach |
| title_exact_search | Probability and information an integrated approach |
| title_exact_search_txtP | Probability and information an integrated approach |
| title_full | Probability and information an integrated approach David Applebaum |
| title_fullStr | Probability and information an integrated approach David Applebaum |
| title_full_unstemmed | Probability and information an integrated approach David Applebaum |
| title_short | Probability and information |
| title_sort | probability and information an integrated approach |
| title_sub | an integrated approach |
| topic | Information, Théorie de l' ram Probabilités Probabilités ram Théorie de l'information Information theory Probabilities Informationstheorie (DE-588)4026927-9 gnd Wahrscheinlichkeitsrechnung (DE-588)4064324-4 gnd Wahrscheinlichkeitstheorie (DE-588)4079013-7 gnd |
| topic_facet | Information, Théorie de l' Probabilités Théorie de l'information Information theory Probabilities Informationstheorie Wahrscheinlichkeitsrechnung Wahrscheinlichkeitstheorie |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=016526193&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT applebaumdavid probabilityandinformationanintegratedapproach |