Discrete stochastic processes:
Saved in:
| Main Author: | |
|---|---|
| Format: | Book |
| Language: | English |
| Published: |
Boston [u.a.]
Kluwer
1996
|
| Series: | The Kluwer international series in engineering and computer science
321 |
| Subjects: | |
| Online Access: | Inhaltsverzeichnis |
| Physical Description: | XIII, 271 S. graph. Darst. |
| ISBN: | 0792395832 9780792395836 |
Staff View
MARC
| LEADER | 00000nam a2200000 cb4500 | ||
|---|---|---|---|
| 001 | BV010644163 | ||
| 003 | DE-604 | ||
| 005 | 20170829 | ||
| 007 | t | ||
| 008 | 960304s1996 xxud||| |||| 00||| eng d | ||
| 020 | |a 0792395832 |9 0-7923-9583-2 | ||
| 020 | |a 9780792395836 |9 978-0-7923-9583-6 | ||
| 035 | |a (OCoLC)32388672 | ||
| 035 | |a (DE-599)BVBBV010644163 | ||
| 040 | |a DE-604 |b ger |e rakddb | ||
| 041 | 0 | |a eng | |
| 044 | |a xxu |c XD-US | ||
| 049 | |a DE-29T |a DE-739 |a DE-19 |a DE-521 |a DE-634 |a DE-91G | ||
| 050 | 0 | |a QA274.G343 1996 | |
| 082 | 0 | |a 519.2 |2 20 | |
| 082 | 0 | |a 519.2 20 | |
| 084 | |a SK 820 |0 (DE-625)143258: |2 rvk | ||
| 084 | |a MAT 605f |2 stub | ||
| 100 | 1 | |a Gallager, Robert G. |e Verfasser |0 (DE-588)128058072 |4 aut | |
| 245 | 1 | 0 | |a Discrete stochastic processes |c by Robert G. Gallager |
| 264 | 1 | |a Boston [u.a.] |b Kluwer |c 1996 | |
| 300 | |a XIII, 271 S. |b graph. Darst. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 490 | 1 | |a The Kluwer international series in engineering and computer science |v 321 | |
| 650 | 4 | |a Stochastic processes | |
| 650 | 0 | 7 | |a Diskreter stochastischer Prozess |0 (DE-588)4150187-1 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Diskreter stochastischer Prozess |0 (DE-588)4150187-1 |D s |
| 689 | 0 | |5 DE-604 | |
| 776 | 0 | 8 | |i Erscheint auch als |n Online-Ausgabe |z 978-1-4615-2329-1 |
| 830 | 0 | |a The Kluwer international series in engineering and computer science |v 321 |w (DE-604)BV023545171 |9 321 | |
| 856 | 4 | 2 | |m HEBIS Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=007102362&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-007102362 | ||
Record in the Search Index
| _version_ | 1804125120033193984 |
|---|---|
| adam_text | Contents
Preface xi
Chapter 1 Introduction and Probability Review 1
1 1 Introduction 1
1 2 Probability Review 2
1 3 Conditional Probabilities 5
1 4 Random Variables 5
1 5 Expectations 8
1 6 Transforms 11
1 7 Weak Law of Large Numbers 12
Basic Inequalities 12
Weak Law Assuming a Finite Variance 14
The Central Limit Theorem 15
Relative Frequency and Indicator Functions 18
Weak Law with Infinite Variance 19
1 8 Strong Law of Large Numbers 21
1 9 Summary 25
Table of Standard Random Variables 25
Exercises 26
Notes 30
Chapter 2 Poisson Processes 31
2 1 Introduction 31
2 2 Definition and Properties of the Poisson Process 33
Memoryless Property 33
Distribution Functions for Sn and N(t) 35
2 3 Combinations and Subdivisions of Independent Poisson Processes 38
Subdividing a Poisson Process 39
Examples Using Independent Poisson Processes 41
2 4 Non-Homogeneous Poisson Processes 41
Example—The M/G/°° Queue 43
2 5 Order Statistics and Conditional Arrival Epochs 45
vii
viii Contents
2 6 Summary 48
Exercises 49
Notes 55
Chapter 3 Renewal Processes 57
3 1 Introduction 57
3 2 Strong Law of Large Numbers for Renewal Processes 58
Central Limit Theorem for N(t) 61
3 3 Expected Number of Renewals 62
Laplace Transform Approach 63
Wald’s Equality 64
Stopping Rules 65
The Elementary Renewal Theorem 67
Blackwell’s Theorem 68
3 4 Renewal Reward Processes; Time Averages 69
Time Average Residual Life 70
Time Average Age 72
Time Average Duration 73
General Renewal Reward Functions 74
Distribution of Residual Life 75
3 5 Renewal Reward Processes; Ensemble Averages 77
3 6 Applications of Renewal Reward Theory 81
Little’s Theorem 81
Expected Queueing Time for an M/G/l Queue 85
3 7 Delayed Renewal Processes 87
Strong Law for Delayed Renewal Processes 88
Elementary Delayed Renewal Theorem 89
Blackwell Theorem for Delayed Renewals 89
Delayed Renewal Reward Processes 90
Transient Behavior of Delayed Renewal Processes 90
Equilibrium Process 91
3 8 Summary 92
Exercises 92
Notes 101
Chapter 4 Finite State Markov Chains 103
4 1 Introduction 103
4 2 Classification of States 105
4 3 The Matrix Representation 109
Eigenvalues and Eigenvectors of P 111
4 4 Perron-Frobenius Theory 112
4 5 Markov Chains with Rewards 119
Expected First Passage Time 119
Contents ix
4 6 Markov Decision Theory and Dynamic Programming 126
Dynamic Programming Algorithm 127
Optimal Stationary Policy 129
Howard’s Policy Improvement Algorithm 132
4 7 Summary 136
Exercises 137
Notes 147
Chapter 5 Markov Chains with Countably Infinite State Spaces 149
5 1 Introduction and Classification of States 149
5 2 Branching Processes 158
5 3 Birth Death Markov Chains 160
5 4 Reversible Markov Chains 161
5 5 The M/M/1 Sampled Time Markov Chain 165
5 6 Round-Robin and Processor Sharing 168
5 7 Semi-Markov Processes 174
5 8 Example—M/G/l Queue 179
5 9 Summary 180
Exercises 181
Chapter 6 Markov Processes with Countable State Spaces 187
6 1 Introduction 187
Pathological Cases 191
6 2 The Kolmogorov Differential Equations 192
6 3 Uniformization 195
6 4 Birth Death Processes 196
6 5 Reversibility for Markov Processes 199
6 6 Jackson Networks 205
Closed Jackson Networks 211
6 7 Summary 213
Exercises 214
Chapter 7 Random Walks and Martingales 223
7 1 Introduction 223
Simple Random Walk 223
7 2 The G/G/l Queue 225
7 3 Detection, Decisions, and Hypothesis Testing 227
7 4 Threshold Crossing Probabilities 229
7 5 Wald’s Identity and Walks with Two Thresholds 232
Joint Distribution of N and Barrier 235
Proof of Wald’s Identity 236
7 6 Martingales and Submartingales 239
Zero Mean Random Walk 240
Sums of Dependent Zero Mean Variables 240
Product Form Martingales 240
Markov Modulated Random Walks 241
Generating Function for Markov Walk 243
Scaled Branching Processes 244
Submartingales and Supermartingales 245
Convex Functions of Martingales 246
7 7 Stopped Processes and Stopping Rules 247
Random Walks with Thresholds 250
Stopping Rules for Martingales Relative to a Process 251
Markov Modulated Random Walks with Thresholds 251
7 8 The Kolmogorov Inequalities 253
Strong Law of Large Numbers 255
Martingale Convergence Theorem 256
7 9 Summary 257
Exercises 258
Notes 263
Bibliography 265
|
| any_adam_object | 1 |
| author | Gallager, Robert G. |
| author_GND | (DE-588)128058072 |
| author_facet | Gallager, Robert G. |
| author_role | aut |
| author_sort | Gallager, Robert G. |
| author_variant | r g g rg rgg |
| building | Verbundindex |
| bvnumber | BV010644163 |
| callnumber-first | Q - Science |
| callnumber-label | QA274 |
| callnumber-raw | QA274.G343 1996 |
| callnumber-search | QA274.G343 1996 |
| callnumber-sort | QA 3274 G343 41996 |
| callnumber-subject | QA - Mathematics |
| classification_rvk | SK 820 |
| classification_tum | MAT 605f |
| ctrlnum | (OCoLC)32388672 (DE-599)BVBBV010644163 |
| dewey-full | 519.2 519.220 |
| dewey-hundreds | 500 - Natural sciences and mathematics |
| dewey-ones | 519 - Probabilities and applied mathematics |
| dewey-raw | 519.2 519.2 20 |
| dewey-search | 519.2 519.2 20 |
| dewey-sort | 3519.2 |
| dewey-tens | 510 - Mathematics |
| discipline | Mathematik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01746nam a2200433 cb4500</leader><controlfield tag="001">BV010644163</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20170829 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">960304s1996 xxud||| |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">0792395832</subfield><subfield code="9">0-7923-9583-2</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9780792395836</subfield><subfield code="9">978-0-7923-9583-6</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)32388672</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV010644163</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakddb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="044" ind1=" " ind2=" "><subfield code="a">xxu</subfield><subfield code="c">XD-US</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-29T</subfield><subfield code="a">DE-739</subfield><subfield code="a">DE-19</subfield><subfield code="a">DE-521</subfield><subfield code="a">DE-634</subfield><subfield code="a">DE-91G</subfield></datafield><datafield tag="050" ind1=" " ind2="0"><subfield code="a">QA274.G343 1996</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">519.2</subfield><subfield code="2">20</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">519.2 20</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">SK 820</subfield><subfield code="0">(DE-625)143258:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">MAT 605f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Gallager, Robert G.</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)128058072</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Discrete stochastic processes</subfield><subfield code="c">by Robert G. Gallager</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Boston [u.a.]</subfield><subfield code="b">Kluwer</subfield><subfield code="c">1996</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XIII, 271 S.</subfield><subfield code="b">graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="1" ind2=" "><subfield code="a">The Kluwer international series in engineering and computer science</subfield><subfield code="v">321</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Stochastic processes</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Diskreter stochastischer Prozess</subfield><subfield code="0">(DE-588)4150187-1</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Diskreter stochastischer Prozess</subfield><subfield code="0">(DE-588)4150187-1</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Online-Ausgabe</subfield><subfield code="z">978-1-4615-2329-1</subfield></datafield><datafield tag="830" ind1=" " ind2="0"><subfield code="a">The Kluwer international series in engineering and computer science</subfield><subfield code="v">321</subfield><subfield code="w">(DE-604)BV023545171</subfield><subfield code="9">321</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">HEBIS Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=007102362&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-007102362</subfield></datafield></record></collection> |
| id | DE-604.BV010644163 |
| illustrated | Illustrated |
| indexdate | 2024-07-09T17:56:30Z |
| institution | BVB |
| isbn | 0792395832 9780792395836 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-007102362 |
| oclc_num | 32388672 |
| open_access_boolean | |
| owner | DE-29T DE-739 DE-19 DE-BY-UBM DE-521 DE-634 DE-91G DE-BY-TUM |
| owner_facet | DE-29T DE-739 DE-19 DE-BY-UBM DE-521 DE-634 DE-91G DE-BY-TUM |
| physical | XIII, 271 S. graph. Darst. |
| publishDate | 1996 |
| publishDateSearch | 1996 |
| publishDateSort | 1996 |
| publisher | Kluwer |
| record_format | marc |
| series | The Kluwer international series in engineering and computer science |
| series2 | The Kluwer international series in engineering and computer science |
| spelling | Gallager, Robert G. Verfasser (DE-588)128058072 aut Discrete stochastic processes by Robert G. Gallager Boston [u.a.] Kluwer 1996 XIII, 271 S. graph. Darst. txt rdacontent n rdamedia nc rdacarrier The Kluwer international series in engineering and computer science 321 Stochastic processes Diskreter stochastischer Prozess (DE-588)4150187-1 gnd rswk-swf Diskreter stochastischer Prozess (DE-588)4150187-1 s DE-604 Erscheint auch als Online-Ausgabe 978-1-4615-2329-1 The Kluwer international series in engineering and computer science 321 (DE-604)BV023545171 321 HEBIS Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=007102362&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Gallager, Robert G. Discrete stochastic processes The Kluwer international series in engineering and computer science Stochastic processes Diskreter stochastischer Prozess (DE-588)4150187-1 gnd |
| subject_GND | (DE-588)4150187-1 |
| title | Discrete stochastic processes |
| title_auth | Discrete stochastic processes |
| title_exact_search | Discrete stochastic processes |
| title_full | Discrete stochastic processes by Robert G. Gallager |
| title_fullStr | Discrete stochastic processes by Robert G. Gallager |
| title_full_unstemmed | Discrete stochastic processes by Robert G. Gallager |
| title_short | Discrete stochastic processes |
| title_sort | discrete stochastic processes |
| topic | Stochastic processes Diskreter stochastischer Prozess (DE-588)4150187-1 gnd |
| topic_facet | Stochastic processes Diskreter stochastischer Prozess |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=007102362&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| volume_link | (DE-604)BV023545171 |
| work_keys_str_mv | AT gallagerrobertg discretestochasticprocesses |