Elements of information theory:
Gespeichert in:
| Hauptverfasser: | , |
|---|---|
| Format: | Elektronisch E-Book |
| Sprache: | English |
| Veröffentlicht: |
Hoboken, NJ
Wiley-Interscience
[2005]
|
| Ausgabe: | 2nd edition |
| Schriftenreihe: | A Wiley-Interscience publication
|
| Schlagworte: | |
| Online-Zugang: | FRO01 TUM01 UBG01 UBT01 UBY01 UPA01 Volltext Inhaltsverzeichnis |
| Beschreibung: | Printausg. 2006 erschienen |
| Beschreibung: | 1 Online-Ressource (xxiii, 748 Seiten) |
| ISBN: | 047174882X 9780471748823 |
Internformat
MARC
| LEADER | 00000nmm a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV022402909 | ||
| 003 | DE-604 | ||
| 005 | 20240107 | ||
| 007 | cr|uuu---uuuuu | ||
| 008 | 070426s2005 |||| o||u| ||||||eng d | ||
| 020 | |a 047174882X |c Online |9 0-471-74882-X | ||
| 020 | |a 9780471748823 |c Online |9 978-0-471-74882-3 | ||
| 024 | 7 | |a 10.1002/047174882X |2 doi | |
| 035 | |a (ZDB-35-WIC)ocm70862892 | ||
| 035 | |a (OCoLC)70862892 | ||
| 035 | |a (DE-599)BVBBV022402909 | ||
| 040 | |a DE-604 |b ger |e rakwb | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-83 |a DE-91 |a DE-703 |a DE-861 |a DE-706 |a DE-739 |a DE-473 | ||
| 050 | 0 | |a Q360 | |
| 082 | 0 | |a 003/.54 |2 22 | |
| 084 | |a SK 830 |0 (DE-625)143259: |2 rvk | ||
| 084 | |a UG 3000 |0 (DE-625)145624: |2 rvk | ||
| 084 | |a SK 880 |0 (DE-625)143266: |2 rvk | ||
| 084 | |a QH 710 |0 (DE-625)141609: |2 rvk | ||
| 084 | |a ST 130 |0 (DE-625)143588: |2 rvk | ||
| 084 | |a ST 273 |0 (DE-625)143640: |2 rvk | ||
| 100 | 1 | |a Cover, Thomas M. |d 1938- |e Verfasser |0 (DE-588)143998269 |4 aut | |
| 245 | 1 | 0 | |a Elements of information theory |c Thomas M. Cover, Joy A. Thomas |
| 250 | |a 2nd edition | ||
| 264 | 1 | |a Hoboken, NJ |b Wiley-Interscience |c [2005] | |
| 264 | 4 | |c © 2005 | |
| 300 | |a 1 Online-Ressource (xxiii, 748 Seiten) | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b c |2 rdamedia | ||
| 338 | |b cr |2 rdacarrier | ||
| 490 | 0 | |a A Wiley-Interscience publication | |
| 500 | |a Printausg. 2006 erschienen | ||
| 650 | 4 | |a Information theory | |
| 650 | 0 | 7 | |a Entropie |g Informationstheorie |0 (DE-588)4743861-7 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Entropie |0 (DE-588)4014894-4 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Informationstheorie |0 (DE-588)4026927-9 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Informationstheorie |0 (DE-588)4026927-9 |D s |
| 689 | 0 | 1 | |a Entropie |g Informationstheorie |0 (DE-588)4743861-7 |D s |
| 689 | 0 | |8 1\p |5 DE-604 | |
| 689 | 1 | 0 | |a Entropie |0 (DE-588)4014894-4 |D s |
| 689 | 1 | 1 | |a Informationstheorie |0 (DE-588)4026927-9 |D s |
| 689 | 1 | |5 DE-604 | |
| 700 | 1 | |a Thomas, Joy A. |e Verfasser |0 (DE-588)1279305614 |4 aut | |
| 776 | 0 | 8 | |i Erscheint auch als |n Druckausgabe |z 0-471-24195-4 |
| 776 | 0 | 8 | |i Erscheint auch als |n Druck-Ausgabe, Hardcover |z 978-0-471-24195-9 |
| 856 | 4 | 0 | |u https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X |x Verlag |3 Volltext |
| 856 | 4 | 2 | |m HBZ Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=015611517&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 912 | |a ZDB-35-WIC | ||
| 999 | |a oai:aleph.bib-bvb.de:BVB01-015611517 | ||
| 883 | 1 | |8 1\p |a cgwrk |d 20201028 |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | |
| 966 | e | |u https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X |l FRO01 |p ZDB-35-WIC |q FRO_PDA_WIC |x Verlag |3 Volltext | |
| 966 | e | |u https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X |l TUM01 |p ZDB-35-WIC |x Verlag |3 Volltext | |
| 966 | e | |u https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X |l UBG01 |p ZDB-35-WIC |q UBG_PDA_WIC_Kauf23 |x Verlag |3 Volltext | |
| 966 | e | |u https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X |l UBT01 |p ZDB-35-WIC |q UBT_Wiley_EK_2007 |x Verlag |3 Volltext | |
| 966 | e | |u https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X |l UBY01 |p ZDB-35-WIC |q UBY_PDA_WIC_Kauf |x Verlag |3 Volltext | |
| 966 | e | |u https://doi.org/10.1002/047174882X |l UPA01 |p ZDB-35-WIC |q UPA_Einzelkauf_2023 |x Verlag |3 Volltext | |
Datensatz im Suchindex
| _version_ | 1804136465184063488 |
|---|---|
| adam_text | CONTENTS
Preface to the Second Edition xv
Preface to the First Edition xvii
Acknowledgments for the Second Edition xxi
Acknowledgments for the First Edition xxiii
1 Introduction and Preview 1
1.1 Preview of the Book 5
2 Entropy, Relative Entropy, and Mutual Information 13
2.1 Entropy 13
2.2 Joint Entropy and Conditional Entropy 16
2.3 Relative Entropy and Mutual Information 19
2.4 Relationship Between Entropy and Mutual
Information 20
2.5 Chain Rules for Entropy, Relative Entropy,
and Mutual Information 22
2.6 Jensen s Inequality and Its Consequences 25
2.7 Log Sum Inequality and Its Applications 30
2.8 Data Processing Inequality 34
2.9 Sufficient Statistics 35
2.10 Fano s Inequality 37
Summary 41
Problems 43
Historical Notes 54
VI CONTENTS
3 Asymptotic Equipartition Property 57
3.1 Asymptotic Equipartition Property Theorem 58
3.2 Consequences of the AEP: Data Compression 60
3.3 High Probability Sets and the Typical Set 62
Summary 64
Problems 64
Historical Notes 69
4 Entropy Rates of a Stochastic Process 71
4.1 Markov Chains 71
4.2 Entropy Rate 74
4.3 Example: Entropy Rate of a Random Walk on a
Weighted Graph 78
4.4 Second Law of Thermodynamics 81
4.5 Functions of Markov Chains 84
Summary 87
Problems 88
Historical Notes 100
5 Data Compression 103
5.1 Examples of Codes 103
5.2 Kraft Inequality 107
5.3 Optimal Codes 110
5.4 Bounds on the Optimal Code Length 112
5.5 Kraft Inequality for Uniquely Decodable
Codes 115
5.6 Huffman Codes 118
5.7 Some Comments on Huffman Codes 120
5.8 Optimality of Huffman Codes 123
5.9 Shannon Fano Elias Coding 127
5.10 Competitive Optimality of the Shannon
Code 130
5.11 Generation of Discrete Distributions from
Fair Coins 134
Summary 141
Problems 142
Historical Notes 157
CONTENTS Vii
6 Gambling and Data Compression 159
6.1 The Horse Race 159
6.2 Gambling and Side Information 164
6.3 Dependent Horse Races and Entropy Rate 166
6.4 The Entropy of English 168
6.5 Data Compression and Gambling 171
6.6 Gambling Estimate of the Entropy of English 173
Summary 175
Problems 176
Historical Notes 182
7 Channel Capacity 183
7.1 Examples of Channel Capacity 184
7.1.1 Noiseless Binary Channel 184
7.1.2 Noisy Channel with Nonoverlapping
Outputs 185
7.1.3 Noisy Typewriter 186
7.1.4 Binary Symmetric Channel 187
7.1.5 Binary Erasure Channel 188
7.2 Symmetric Channels 189
7.3 Properties of Channel Capacity 191
7.4 Preview of the Channel Coding Theorem 191
7.5 Definitions 192
7.6 Jointly Typical Sequences 195
7.7 Channel Coding Theorem 199
7.8 Zero Error Codes 205
7.9 Fano s Inequality and the Converse to the Coding
Theorem 206
7.10 Equality in the Converse to the Channel Coding
Theorem 208
7.11 Hamming Codes 210
7.12 Feedback Capacity 216
7.13 Source Channel Separation Theorem 218
Summary 222
Problems 223
Historical Notes 240
Vlii CONTENTS
8 Differential Entropy 243
8.1 Definitions 243
8.2 AEP for Continuous Random Variables 245
8.3 Relation of Differential Entropy to Discrete
Entropy 247
8.4 Joint and Conditional Differential Entropy 249
8.5 Relative Entropy and Mutual Information 250
8.6 Properties of Differential Entropy, Relative Entropy,
and Mutual Information 252
Summary 256
Problems 256
Historical Notes 259
9 Gaussian Channel 261
9.1 Gaussian Channel: Definitions 263
9.2 Converse to the Coding Theorem for Gaussian
Channels 268
9.3 Bandlimited Channels 270
9.4 Parallel Gaussian Channels 274
9.5 Channels with Colored Gaussian Noise 277
9.6 Gaussian Channels with Feedback 280
Summary 289
Problems 290
Historical Notes 299
10 Rate Distortion Theory 301
10.1 Quantization 301
10.2 Definitions 303
10.3 Calculation of the Rate Distortion Function 307
10.3.1 Binary Source 307
10.3.2 Gaussian Source 310
10.3.3 Simultaneous Description of Independent
Gaussian Random Variables 312
10.4 Converse to the Rate Distortion Theorem 315
10.5 Achievability of the Rate Distortion Function 318
10.6 Strongly Typical Sequences and Rate Distortion 325
10.7 Characterization of the Rate Distortion Function 329
CONTENTS IX
10.8 Computation of Channel Capacity and the Rate
Distortion Function 332
Summary 335
Problems 336
Historical Notes 345
11 Information Theory and Statistics 347
11.1 Method of Types 347
11.2 Law of Large Numbers 355
11.3 Universal Source Coding 357
11.4 Large Deviation Theory 360
11.5 Examples of Sanov s Theorem 364
11.6 Conditional Limit Theorem 366
11.7 Hypothesis Testing 375
11.8 Chernoff Stein Lemma 380
11.9 Chernoff Information 384
11.10 Fisher Information and the Cramer Rao
Inequality 392
Summary 397
Problems 399
Historical Notes 408
12 Maximum Entropy 409
12.1 Maximum Entropy Distributions 409
12.2 Examples 411
12.3 Anomalous Maximum Entropy Problem 413
12.4 Spectrum Estimation 415
12.5 Entropy Rates of a Gaussian Process 416
12.6 Burg s Maximum Entropy Theorem 417
Summary 420
Problems 421
Historical Notes 425
13 Universal Source Coding 427
13.1 Universal Codes and Channel Capacity 428
13.2 Universal Coding for Binary Sequences 433
13.3 Arithmetic Coding 436
X CONTENTS
13.4 Lempel Ziv Coding 440
13.4.1 Sliding Window Lempel Ziv
Algorithm 441
13.4.2 Tree Structured Lempel Ziv
Algorithms 442
13.5 Optimality of Lempel Ziv Algorithms 443
13.5.1 Sliding Window Lempel Ziv
Algorithms 443
13.5.2 Optimality of Tree Structured Lempel Ziv
Compression 448
Summary 456
Problems 457
Historical Notes 461
14 Kolmogorov Complexity 463
14.1 Models of Computation 464
14.2 Kolmogorov Complexity: Definitions
and Examples 466
14.3 Kolmogorov Complexity and Entropy 473
14.4 Kolmogorov Complexity of Integers 475
14.5 Algorithmically Random and Incompressible
Sequences 476
14.6 Universal Probability 480
14.7 Kolmogorov complexity 482
14.8 Q 484
14.9 Universal Gambling 487
14.10 Occam s Razor 488
14.11 Kolmogorov Complexity and Universal
Probability 490
14.12 Kolmogorov Sufficient Statistic 496
14.13 Minimum Description Length Principle 500
Summary 501
Problems 503
Historical Notes 507
15 Network Information Theory 509
15.1 Gaussian Multiple User Channels 513
CONTENTS xi
15.1.1 Single User Gaussian Channel 513
15.1.2 Gaussian Multiple Access Channel
with m Users 514
15.1.3 Gaussian Broadcast Channel 515
15.1.4 Gaussian Relay Channel 516
15.1.5 Gaussian Interference Channel 518
15.1.6 Gaussian Two Way Channel 519
15.2 Jointly Typical Sequences 520
15.3 Multiple Access Channel 524
15.3.1 Achievability of the Capacity Region for the
Multiple Access Channel 530
15.3.2 Comments on the Capacity Region for the
Multiple Access Channel 532
15.3.3 Convexity of the Capacity Region of the
Multiple Access Channel 534
15.3.4 Converse for the Multiple Access
Channel 538
15.3.5 m User Multiple Access Channels 543
15.3.6 Gaussian Multiple Access Channels 544
15.4 Encoding of Correlated Sources 549
15.4.1 Achievability of the Slepian Wolf
Theorem 551
15.4.2 Converse for the Slepian Wolf
Theorem 555
15.4.3 Slepian Wolf Theorem for Many
Sources 556
15.4.4 Interpretation of Slepian Wolf
Coding 557
15.5 Duality Between Slepian Wolf Encoding and
Multiple Access Channels 558
15.6 Broadcast Channel 560
15.6.1 Definitions for a Broadcast Channel 563
15.6.2 Degraded Broadcast Channels 564
15.6.3 Capacity Region for the Degraded Broadcast
Channel 565
15.7 Relay Channel 571
15.8 Source Coding with Side Information 575
15.9 Rate Distortion with Side Information 580
xii CONTENTS
15.10 General Multiterminal Networks 5X7
Summary 594
Problems 596
Historical Notes 609
16 Information Theory and Portfolio Theory 613
16.1 The Stock Market: Some Definitions 613
16.2 Kuhn Tucker Characterization of the Log Optimal
Portfolio 617
16.3 Asymptotic Optimality of the Log Optimal
Portfolio 619
16.4 Side Information and the Growth Rate 621
16.5 Investment in Stationary Markets 623
16.6 Competitive Optimality of the Log Optimal
Portfolio 627
16.7 Universal Portfolios 629
16.7.1 Finite Horizon Universal Portfolios 631
16.7.2 Horizon Free Universal Portfolios 638
16.8 Shannon McMillan Breiman Theorem
(General AEP) 644
Summary 650
Problems 652
Historical Notes 655
17 Inequalities in Information Theory 657
17.1 Basic Inequalities of Information Theory 657
17.2 Differential Entropy 660
17.3 Bounds on Entropy and Relative Entropy 663
17.4 Inequalities for Types 665
17.5 Combinatorial Bounds on Entropy 666
17.6 Entropy Rates of Subsets 667
17.7 Entropy and Fisher Information 671
17.8 Entropy Power Inequality and Brunn Minkowski
Inequality 674
17.9 Inequalities for Determinants 679
CONTENTS xiii
17.10 Inequalities for Ratios of Determinants 683
Summary 686
Problems 686
Historical Notes 687
Bibliography 689
List of Symbols 723
Index 727
|
| adam_txt |
CONTENTS
Preface to the Second Edition xv
Preface to the First Edition xvii
Acknowledgments for the Second Edition xxi
Acknowledgments for the First Edition xxiii
1 Introduction and Preview 1
1.1 Preview of the Book 5
2 Entropy, Relative Entropy, and Mutual Information 13
2.1 Entropy 13
2.2 Joint Entropy and Conditional Entropy 16
2.3 Relative Entropy and Mutual Information 19
2.4 Relationship Between Entropy and Mutual
Information 20
2.5 Chain Rules for Entropy, Relative Entropy,
and Mutual Information 22
2.6 Jensen's Inequality and Its Consequences 25
2.7 Log Sum Inequality and Its Applications 30
2.8 Data Processing Inequality 34
2.9 Sufficient Statistics 35
2.10 Fano's Inequality 37
Summary 41
Problems 43
Historical Notes 54
VI CONTENTS
3 Asymptotic Equipartition Property 57
3.1 Asymptotic Equipartition Property Theorem 58
3.2 Consequences of the AEP: Data Compression 60
3.3 High Probability Sets and the Typical Set 62
Summary 64
Problems 64
Historical Notes 69
4 Entropy Rates of a Stochastic Process 71
4.1 Markov Chains 71
4.2 Entropy Rate 74
4.3 Example: Entropy Rate of a Random Walk on a
Weighted Graph 78
4.4 Second Law of Thermodynamics 81
4.5 Functions of Markov Chains 84
Summary 87
Problems 88
Historical Notes 100
5 Data Compression 103
5.1 Examples of Codes 103
5.2 Kraft Inequality 107
5.3 Optimal Codes 110
5.4 Bounds on the Optimal Code Length 112
5.5 Kraft Inequality for Uniquely Decodable
Codes 115
5.6 Huffman Codes 118
5.7 Some Comments on Huffman Codes 120
5.8 Optimality of Huffman Codes 123
5.9 Shannon Fano Elias Coding 127
5.10 Competitive Optimality of the Shannon
Code 130
5.11 Generation of Discrete Distributions from
Fair Coins 134
Summary 141
Problems 142
Historical Notes 157
CONTENTS Vii
6 Gambling and Data Compression 159
6.1 The Horse Race 159
6.2 Gambling and Side Information 164
6.3 Dependent Horse Races and Entropy Rate 166
6.4 The Entropy of English 168
6.5 Data Compression and Gambling 171
6.6 Gambling Estimate of the Entropy of English 173
Summary 175
Problems 176
Historical Notes 182
7 Channel Capacity 183
7.1 Examples of Channel Capacity 184
7.1.1 Noiseless Binary Channel 184
7.1.2 Noisy Channel with Nonoverlapping
Outputs 185
7.1.3 Noisy Typewriter 186
7.1.4 Binary Symmetric Channel 187
7.1.5 Binary Erasure Channel 188
7.2 Symmetric Channels 189
7.3 Properties of Channel Capacity 191
7.4 Preview of the Channel Coding Theorem 191
7.5 Definitions 192
7.6 Jointly Typical Sequences 195
7.7 Channel Coding Theorem 199
7.8 Zero Error Codes 205
7.9 Fano's Inequality and the Converse to the Coding
Theorem 206
7.10 Equality in the Converse to the Channel Coding
Theorem 208
7.11 Hamming Codes 210
7.12 Feedback Capacity 216
7.13 Source Channel Separation Theorem 218
Summary 222
Problems 223
Historical Notes 240
Vlii CONTENTS
8 Differential Entropy 243
8.1 Definitions 243
8.2 AEP for Continuous Random Variables 245
8.3 Relation of Differential Entropy to Discrete
Entropy 247
8.4 Joint and Conditional Differential Entropy 249
8.5 Relative Entropy and Mutual Information 250
8.6 Properties of Differential Entropy, Relative Entropy,
and Mutual Information 252
Summary 256
Problems 256
Historical Notes 259
9 Gaussian Channel 261
9.1 Gaussian Channel: Definitions 263
9.2 Converse to the Coding Theorem for Gaussian
Channels 268
9.3 Bandlimited Channels 270
9.4 Parallel Gaussian Channels 274
9.5 Channels with Colored Gaussian Noise 277
9.6 Gaussian Channels with Feedback 280
Summary 289
Problems 290
Historical Notes 299
10 Rate Distortion Theory 301
10.1 Quantization 301
10.2 Definitions 303
10.3 Calculation of the Rate Distortion Function 307
10.3.1 Binary Source 307
10.3.2 Gaussian Source 310
10.3.3 Simultaneous Description of Independent
Gaussian Random Variables 312
10.4 Converse to the Rate Distortion Theorem 315
10.5 Achievability of the Rate Distortion Function 318
10.6 Strongly Typical Sequences and Rate Distortion 325
10.7 Characterization of the Rate Distortion Function 329
CONTENTS IX
10.8 Computation of Channel Capacity and the Rate
Distortion Function 332
Summary 335
Problems 336
Historical Notes 345
11 Information Theory and Statistics 347
11.1 Method of Types 347
11.2 Law of Large Numbers 355
11.3 Universal Source Coding 357
11.4 Large Deviation Theory 360
11.5 Examples of Sanov's Theorem 364
11.6 Conditional Limit Theorem 366
11.7 Hypothesis Testing 375
11.8 Chernoff Stein Lemma 380
11.9 Chernoff Information 384
11.10 Fisher Information and the Cramer Rao
Inequality 392
Summary 397
Problems 399
Historical Notes 408
12 Maximum Entropy 409
12.1 Maximum Entropy Distributions 409
12.2 Examples 411
12.3 Anomalous Maximum Entropy Problem 413
12.4 Spectrum Estimation 415
12.5 Entropy Rates of a Gaussian Process 416
12.6 Burg's Maximum Entropy Theorem 417
Summary 420
Problems 421
Historical Notes 425
13 Universal Source Coding 427
13.1 Universal Codes and Channel Capacity 428
13.2 Universal Coding for Binary Sequences 433
13.3 Arithmetic Coding 436
X CONTENTS
13.4 Lempel Ziv Coding 440
13.4.1 Sliding Window Lempel Ziv
Algorithm 441
13.4.2 Tree Structured Lempel Ziv
Algorithms 442
13.5 Optimality of Lempel Ziv Algorithms 443
13.5.1 Sliding Window Lempel Ziv
Algorithms 443
13.5.2 Optimality of Tree Structured Lempel Ziv
Compression 448
Summary 456
Problems 457
Historical Notes 461
14 Kolmogorov Complexity 463
14.1 Models of Computation 464
14.2 Kolmogorov Complexity: Definitions
and Examples 466
14.3 Kolmogorov Complexity and Entropy 473
14.4 Kolmogorov Complexity of Integers 475
14.5 Algorithmically Random and Incompressible
Sequences 476
14.6 Universal Probability 480
14.7 Kolmogorov complexity 482
14.8 Q 484
14.9 Universal Gambling 487
14.10 Occam's Razor 488
14.11 Kolmogorov Complexity and Universal
Probability 490
14.12 Kolmogorov Sufficient Statistic 496
14.13 Minimum Description Length Principle 500
Summary 501
Problems 503
Historical Notes 507
15 Network Information Theory 509
15.1 Gaussian Multiple User Channels 513
CONTENTS xi
15.1.1 Single User Gaussian Channel 513
15.1.2 Gaussian Multiple Access Channel
with m Users 514
15.1.3 Gaussian Broadcast Channel 515
15.1.4 Gaussian Relay Channel 516
15.1.5 Gaussian Interference Channel 518
15.1.6 Gaussian Two Way Channel 519
15.2 Jointly Typical Sequences 520
15.3 Multiple Access Channel 524
15.3.1 Achievability of the Capacity Region for the
Multiple Access Channel 530
15.3.2 Comments on the Capacity Region for the
Multiple Access Channel 532
15.3.3 Convexity of the Capacity Region of the
Multiple Access Channel 534
15.3.4 Converse for the Multiple Access
Channel 538
15.3.5 m User Multiple Access Channels 543
15.3.6 Gaussian Multiple Access Channels 544
15.4 Encoding of Correlated Sources 549
15.4.1 Achievability of the Slepian Wolf
Theorem 551
15.4.2 Converse for the Slepian Wolf
Theorem 555
15.4.3 Slepian Wolf Theorem for Many
Sources 556
15.4.4 Interpretation of Slepian Wolf
Coding 557
15.5 Duality Between Slepian Wolf Encoding and
Multiple Access Channels 558
15.6 Broadcast Channel 560
15.6.1 Definitions for a Broadcast Channel 563
15.6.2 Degraded Broadcast Channels 564
15.6.3 Capacity Region for the Degraded Broadcast
Channel 565
15.7 Relay Channel 571
15.8 Source Coding with Side Information 575
15.9 Rate Distortion with Side Information 580
xii CONTENTS
15.10 General Multiterminal Networks 5X7
Summary 594
Problems 596
Historical Notes 609
16 Information Theory and Portfolio Theory 613
16.1 The Stock Market: Some Definitions 613
16.2 Kuhn Tucker Characterization of the Log Optimal
Portfolio 617
16.3 Asymptotic Optimality of the Log Optimal
Portfolio 619
16.4 Side Information and the Growth Rate 621
16.5 Investment in Stationary Markets 623
16.6 Competitive Optimality of the Log Optimal
Portfolio 627
16.7 Universal Portfolios 629
16.7.1 Finite Horizon Universal Portfolios 631
16.7.2 Horizon Free Universal Portfolios 638
16.8 Shannon McMillan Breiman Theorem
(General AEP) 644
Summary 650
Problems 652
Historical Notes 655
17 Inequalities in Information Theory 657
17.1 Basic Inequalities of Information Theory 657
17.2 Differential Entropy 660
17.3 Bounds on Entropy and Relative Entropy 663
17.4 Inequalities for Types 665
17.5 Combinatorial Bounds on Entropy 666
17.6 Entropy Rates of Subsets 667
17.7 Entropy and Fisher Information 671
17.8 Entropy Power Inequality and Brunn Minkowski
Inequality 674
17.9 Inequalities for Determinants 679
CONTENTS xiii
17.10 Inequalities for Ratios of Determinants 683
Summary 686
Problems 686
Historical Notes 687
Bibliography 689
List of Symbols 723
Index 727 |
| any_adam_object | 1 |
| any_adam_object_boolean | 1 |
| author | Cover, Thomas M. 1938- Thomas, Joy A. |
| author_GND | (DE-588)143998269 (DE-588)1279305614 |
| author_facet | Cover, Thomas M. 1938- Thomas, Joy A. |
| author_role | aut aut |
| author_sort | Cover, Thomas M. 1938- |
| author_variant | t m c tm tmc j a t ja jat |
| building | Verbundindex |
| bvnumber | BV022402909 |
| callnumber-first | Q - Science |
| callnumber-label | Q360 |
| callnumber-raw | Q360 |
| callnumber-search | Q360 |
| callnumber-sort | Q 3360 |
| callnumber-subject | Q - General Science |
| classification_rvk | SK 830 UG 3000 SK 880 QH 710 ST 130 ST 273 |
| collection | ZDB-35-WIC |
| ctrlnum | (ZDB-35-WIC)ocm70862892 (OCoLC)70862892 (DE-599)BVBBV022402909 |
| dewey-full | 003/.54 |
| dewey-hundreds | 000 - Computer science, information, general works |
| dewey-ones | 003 - Systems |
| dewey-raw | 003/.54 |
| dewey-search | 003/.54 |
| dewey-sort | 13 254 |
| dewey-tens | 000 - Computer science, information, general works |
| discipline | Physik Informatik Mathematik Wirtschaftswissenschaften |
| discipline_str_mv | Physik Informatik Mathematik Wirtschaftswissenschaften |
| edition | 2nd edition |
| format | Electronic eBook |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>03370nmm a2200709 c 4500</leader><controlfield tag="001">BV022402909</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20240107 </controlfield><controlfield tag="007">cr|uuu---uuuuu</controlfield><controlfield tag="008">070426s2005 |||| o||u| ||||||eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">047174882X</subfield><subfield code="c">Online</subfield><subfield code="9">0-471-74882-X</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9780471748823</subfield><subfield code="c">Online</subfield><subfield code="9">978-0-471-74882-3</subfield></datafield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1002/047174882X</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(ZDB-35-WIC)ocm70862892</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)70862892</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV022402909</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-83</subfield><subfield code="a">DE-91</subfield><subfield code="a">DE-703</subfield><subfield code="a">DE-861</subfield><subfield code="a">DE-706</subfield><subfield code="a">DE-739</subfield><subfield code="a">DE-473</subfield></datafield><datafield tag="050" ind1=" " ind2="0"><subfield code="a">Q360</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">003/.54</subfield><subfield code="2">22</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">SK 830</subfield><subfield code="0">(DE-625)143259:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">UG 3000</subfield><subfield code="0">(DE-625)145624:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">SK 880</subfield><subfield code="0">(DE-625)143266:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">QH 710</subfield><subfield code="0">(DE-625)141609:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 130</subfield><subfield code="0">(DE-625)143588:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 273</subfield><subfield code="0">(DE-625)143640:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Cover, Thomas M.</subfield><subfield code="d">1938-</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)143998269</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Elements of information theory</subfield><subfield code="c">Thomas M. Cover, Joy A. Thomas</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">2nd edition</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Hoboken, NJ</subfield><subfield code="b">Wiley-Interscience</subfield><subfield code="c">[2005]</subfield></datafield><datafield tag="264" ind1=" " ind2="4"><subfield code="c">© 2005</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">1 Online-Ressource (xxiii, 748 Seiten)</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="0" ind2=" "><subfield code="a">A Wiley-Interscience publication</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">Printausg. 2006 erschienen</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Information theory</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Entropie</subfield><subfield code="g">Informationstheorie</subfield><subfield code="0">(DE-588)4743861-7</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Entropie</subfield><subfield code="0">(DE-588)4014894-4</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Informationstheorie</subfield><subfield code="0">(DE-588)4026927-9</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Informationstheorie</subfield><subfield code="0">(DE-588)4026927-9</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Entropie</subfield><subfield code="g">Informationstheorie</subfield><subfield code="0">(DE-588)4743861-7</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="8">1\p</subfield><subfield code="5">DE-604</subfield></datafield><datafield tag="689" ind1="1" ind2="0"><subfield code="a">Entropie</subfield><subfield code="0">(DE-588)4014894-4</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2="1"><subfield code="a">Informationstheorie</subfield><subfield code="0">(DE-588)4026927-9</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Thomas, Joy A.</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1279305614</subfield><subfield code="4">aut</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Druckausgabe</subfield><subfield code="z">0-471-24195-4</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Druck-Ausgabe, Hardcover</subfield><subfield code="z">978-0-471-24195-9</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X</subfield><subfield code="x">Verlag</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">HBZ Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=015611517&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">ZDB-35-WIC</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-015611517</subfield></datafield><datafield tag="883" ind1="1" ind2=" "><subfield code="8">1\p</subfield><subfield code="a">cgwrk</subfield><subfield code="d">20201028</subfield><subfield code="q">DE-101</subfield><subfield code="u">https://d-nb.info/provenance/plan#cgwrk</subfield></datafield><datafield tag="966" ind1="e" ind2=" "><subfield code="u">https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X</subfield><subfield code="l">FRO01</subfield><subfield code="p">ZDB-35-WIC</subfield><subfield code="q">FRO_PDA_WIC</subfield><subfield code="x">Verlag</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="966" ind1="e" ind2=" "><subfield code="u">https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X</subfield><subfield code="l">TUM01</subfield><subfield code="p">ZDB-35-WIC</subfield><subfield code="x">Verlag</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="966" ind1="e" ind2=" "><subfield code="u">https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X</subfield><subfield code="l">UBG01</subfield><subfield code="p">ZDB-35-WIC</subfield><subfield code="q">UBG_PDA_WIC_Kauf23</subfield><subfield code="x">Verlag</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="966" ind1="e" ind2=" "><subfield code="u">https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X</subfield><subfield code="l">UBT01</subfield><subfield code="p">ZDB-35-WIC</subfield><subfield code="q">UBT_Wiley_EK_2007</subfield><subfield code="x">Verlag</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="966" ind1="e" ind2=" "><subfield code="u">https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X</subfield><subfield code="l">UBY01</subfield><subfield code="p">ZDB-35-WIC</subfield><subfield code="q">UBY_PDA_WIC_Kauf</subfield><subfield code="x">Verlag</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="966" ind1="e" ind2=" "><subfield code="u">https://doi.org/10.1002/047174882X</subfield><subfield code="l">UPA01</subfield><subfield code="p">ZDB-35-WIC</subfield><subfield code="q">UPA_Einzelkauf_2023</subfield><subfield code="x">Verlag</subfield><subfield code="3">Volltext</subfield></datafield></record></collection> |
| id | DE-604.BV022402909 |
| illustrated | Not Illustrated |
| index_date | 2024-07-02T17:19:00Z |
| indexdate | 2024-07-09T20:56:50Z |
| institution | BVB |
| isbn | 047174882X 9780471748823 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-015611517 |
| oclc_num | 70862892 |
| open_access_boolean | |
| owner | DE-83 DE-91 DE-BY-TUM DE-703 DE-861 DE-706 DE-739 DE-473 DE-BY-UBG |
| owner_facet | DE-83 DE-91 DE-BY-TUM DE-703 DE-861 DE-706 DE-739 DE-473 DE-BY-UBG |
| physical | 1 Online-Ressource (xxiii, 748 Seiten) |
| psigel | ZDB-35-WIC ZDB-35-WIC FRO_PDA_WIC ZDB-35-WIC UBG_PDA_WIC_Kauf23 ZDB-35-WIC UBT_Wiley_EK_2007 ZDB-35-WIC UBY_PDA_WIC_Kauf ZDB-35-WIC UPA_Einzelkauf_2023 |
| publishDate | 2005 |
| publishDateSearch | 2005 |
| publishDateSort | 2005 |
| publisher | Wiley-Interscience |
| record_format | marc |
| series2 | A Wiley-Interscience publication |
| spelling | Cover, Thomas M. 1938- Verfasser (DE-588)143998269 aut Elements of information theory Thomas M. Cover, Joy A. Thomas 2nd edition Hoboken, NJ Wiley-Interscience [2005] © 2005 1 Online-Ressource (xxiii, 748 Seiten) txt rdacontent c rdamedia cr rdacarrier A Wiley-Interscience publication Printausg. 2006 erschienen Information theory Entropie Informationstheorie (DE-588)4743861-7 gnd rswk-swf Entropie (DE-588)4014894-4 gnd rswk-swf Informationstheorie (DE-588)4026927-9 gnd rswk-swf Informationstheorie (DE-588)4026927-9 s Entropie Informationstheorie (DE-588)4743861-7 s 1\p DE-604 Entropie (DE-588)4014894-4 s DE-604 Thomas, Joy A. Verfasser (DE-588)1279305614 aut Erscheint auch als Druckausgabe 0-471-24195-4 Erscheint auch als Druck-Ausgabe, Hardcover 978-0-471-24195-9 https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X Verlag Volltext HBZ Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=015611517&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis 1\p cgwrk 20201028 DE-101 https://d-nb.info/provenance/plan#cgwrk |
| spellingShingle | Cover, Thomas M. 1938- Thomas, Joy A. Elements of information theory Information theory Entropie Informationstheorie (DE-588)4743861-7 gnd Entropie (DE-588)4014894-4 gnd Informationstheorie (DE-588)4026927-9 gnd |
| subject_GND | (DE-588)4743861-7 (DE-588)4014894-4 (DE-588)4026927-9 |
| title | Elements of information theory |
| title_auth | Elements of information theory |
| title_exact_search | Elements of information theory |
| title_exact_search_txtP | Elements of information theory |
| title_full | Elements of information theory Thomas M. Cover, Joy A. Thomas |
| title_fullStr | Elements of information theory Thomas M. Cover, Joy A. Thomas |
| title_full_unstemmed | Elements of information theory Thomas M. Cover, Joy A. Thomas |
| title_short | Elements of information theory |
| title_sort | elements of information theory |
| topic | Information theory Entropie Informationstheorie (DE-588)4743861-7 gnd Entropie (DE-588)4014894-4 gnd Informationstheorie (DE-588)4026927-9 gnd |
| topic_facet | Information theory Entropie Informationstheorie Entropie Informationstheorie |
| url | https://onlinelibrary.wiley.com/doi/book/10.1002/047174882X http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=015611517&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT coverthomasm elementsofinformationtheory AT thomasjoya elementsofinformationtheory |