Statistical mechanics of neural networks: enhancement by weighting of examples
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Format: | Abschlussarbeit Buch |
| Sprache: | English |
| Veröffentlicht: |
Aachen
Shaker
2001
|
| Schriftenreihe: | Berichte aus der Physik
|
| Schlagworte: | |
| Online-Zugang: | Inhaltsverzeichnis |
| Beschreibung: | IV, 150 S. graph. Darst. |
| ISBN: | 3826592794 |
Internformat
MARC
| LEADER | 00000nam a22000008c 4500 | ||
|---|---|---|---|
| 001 | BV013927221 | ||
| 003 | DE-604 | ||
| 005 | 20121121 | ||
| 007 | t | ||
| 008 | 010918s2001 gw d||| m||| 00||| eng d | ||
| 016 | 7 | |a 962376825 |2 DE-101 | |
| 020 | |a 3826592794 |9 3-8265-9279-4 | ||
| 035 | |a (OCoLC)50524123 | ||
| 035 | |a (DE-599)BVBBV013927221 | ||
| 040 | |a DE-604 |b ger |e rakddb | ||
| 041 | 0 | |a eng | |
| 044 | |a gw |c DE | ||
| 049 | |a DE-20 |a DE-703 |a DE-355 |a DE-188 | ||
| 100 | 1 | |a Dietrich, Rainer |d 1970- |e Verfasser |0 (DE-588)123239486 |4 aut | |
| 245 | 1 | 0 | |a Statistical mechanics of neural networks |b enhancement by weighting of examples |c Rainer Dietrich |
| 264 | 1 | |a Aachen |b Shaker |c 2001 | |
| 300 | |a IV, 150 S. |b graph. Darst. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 490 | 0 | |a Berichte aus der Physik | |
| 502 | |a Zugl.: Würzburg, Univ., Diss., 2000 | ||
| 650 | 0 | 7 | |a Statistische Mechanik |0 (DE-588)4056999-8 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Neuronales Netz |0 (DE-588)4226127-2 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Maschinelles Lernen |0 (DE-588)4193754-5 |2 gnd |9 rswk-swf |
| 655 | 7 | |0 (DE-588)4113937-9 |a Hochschulschrift |2 gnd-content | |
| 689 | 0 | 0 | |a Statistische Mechanik |0 (DE-588)4056999-8 |D s |
| 689 | 0 | 1 | |a Neuronales Netz |0 (DE-588)4226127-2 |D s |
| 689 | 0 | 2 | |a Maschinelles Lernen |0 (DE-588)4193754-5 |D s |
| 689 | 0 | |5 DE-604 | |
| 856 | 4 | 2 | |m DNB Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=009530733&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-009530733 | |
Datensatz im Suchindex
| _version_ | 1808136986990477312 |
|---|---|
| adam_text |
CONTENTS
1
INTRODUCTION
1
1.1
COMPUTATIONAL
LEARNING
THEORY
.
2
1.2
REGRESSION
ESTIMATION
.
3
1.2.1
PARAMETRIC
MODELS
.
3
1.2.2
NONPARAMETRIC
MODELS
.
6
1.2.3
ERROR
MEASURES
.
6
1.3
BAYESIAN
FRAMEWORK
.
7
1.4
STATISTICAL
PHYSICS
.
8
1.5
OUTLINE
OF
THIS
THESIS
.
9
2
OUTLIERS
11
2.1
SETTING
THE
PROBLEM
.
11
2.2
STATISTICAL
MECHANICS
.
15
2.3
EM-ALGORITHM
.
17
2.3.1
SOFT
SELECTION
.
18
2.3.2
HARD
SELECTION
.
19
2.4
STATISTICAL
MECHANICS
FOR
THE
HARD
SELECTION
.
19
2.5
RESULTS
AND
DISCUSSION
.
21
2.5.1
SOFT
SELECTION
.
21
2.5.2
HARD
SELECTION
.
27
2.6
CONCLUSION
.
29
3
SUPPORT-VECTOR
NETWORKS
31
3.1
INTRODUCTION
.
31
3.1.1
BASIC
IDEAS
.
31
3.1.2
EXAMPLE
.
33
3.2
PROBLEMS
.
35
3.3
OPTIMISATION
PROBLEM
.
35
3.4
EIGENVALUE
EXPANSION
.
39
3.5
STATISTICAL
PHYSICS
.
41
3.6
EXTENSIONS
TO
THE
BASIC
CALCULATION
.
44
3.6.1
STRUCTURED
INPUT
DISTRIBUTION
.
44
3.6.2
INPUT
NOISE
.
45
II
CONTENTS
3.7
INTERESTING
QUANTITIES
.
46
3.7.1
ORDER
PARAMETERS
.
46
3.7.2
GENERALISATION
ERROR
.
47
3.7.3
NUMBER
OF
SUPPORT
VECTORS
.
48
3.7.4
DISTRIBUTION
OF
EMBEDDING
STRENGTHS
.
49
3.7.5
STORAGE
CAPACITY
.
50
3.8
RESULTS
FOR
DIFFERENT
ARCHITECTURES
.
51
3.8.1
STUDENT
AND
TEACHER
HAVE
THE
SAME
STRUCTURE
.
52
3.8.2
STUDENT
IS
SIMPLER
THAN
TEACHER
.
58
3.8.3
TEACHER
IS
SIMPLER
THAN
STUDENT
.
62
3.9
SIGNAL-TO-NOISE
ANALYSIS
.
64
3.10
SVM-CLASSIFICATION
FOR
FINITE
N
.
67
3.11
CONCLUSION
.
70
4
EXTENSIONS
OF
THE
KERNEL
METHOD
73
4.1
COMPARISON:
HEBB
WITH
KERNEL
.
73
4.2
BAYES-CLASSIFICATION
.
77
4.3
MAP
WITH
KERNEL
.
80
4.4
BAYES-REGRESSION
.
82
4.5
CONCLUSION
.
86
5
SUMMARY
87
A
STATISTICAL
PHYSICS
FOR
NON-PHYSICISTS
91
B
DETAILS
FOR
THE
ANALYSIS
OF
THE
EM
ALGORITHM
95
B.L
PROOF
OF
CONVERGENCE
FOR
THE
EM
ALGORITHM
.
95
B.2
STATISTICAL
MECHANICS
FOR
THE
SOFT
SELECTION
.
96
B.3
STATISTICAL
MECHANICS
FOR
THE
HARD
SELECTION
.
100
C
CALCULATION
OF
THE
KERNEL
EIGENVALUES
A.
P
103
D
REPLICA
CALCULATION
FOR
SVM
107
D.L
BASIC
CALCULATION
.
107
D.L.L
AVERAGE
OVER
PATTERNS
.
108
D.L.
2
INTEGRAL
OVER
WEIGHTS
.
ILL
D.L.
3
FREE
ENERGY
.
113
D.2
NORMALISATION
CONSTANT
FOR
SVM
WITH
GAP
.
113
D.3
VARIATIONS
FOR
INPUT
NOISE
.
114
D.4
DISTRIBUTION
OF EMBEDDING
STRENGTHS
.
115
D.5
SVM-CLASSIFICATION
FOR
FINITE
N
.
118
CONTENTS
III
E
ASYMPTOTIC
CALCULATIONS
121
E.L
GENERAL
SADDLE-POINT
EQUATIONS
.
121
E.2
TEACHER
IS
SIMPLER
THAN
STUDENT
.
123
E.3
STUDENT
AND
TEACHER
HAVE
THE
SAME
STRUCTURE
.
125
E.3.1
ASYMPTOTICS
WITHOUT
GAP:
INTERMEDIATE
CASCADES
.
125
E.3.
2
ASYMPTOTICS
WITHOUT
GAP:
FINAL
CASCADE
.
126
E.3.3
ASYMPTOTICS
WITH
GAP
7:
FINAL
CASCADE
.
128
E.3.4
MATHEMATICAL
SUPPLEMENT
.
130
F
GENERAL
SIGNAL-TO-NOISE
ANALYSIS
133
F.L
TEACHER
IS
SIMPLER
THAN
STUDENT
.
133
F.2
STUDENT
MATCHES
TEACHER
.
135
G
DETAILS
FOR
MAP
WITH
KERNEL
137
H
GAUSSIAN
PROCESSES
139
H.L
GENERAL
PROPERTIES
.
YY
.
139
H.2
GAUSSIAN
PROCESSES
FOR
REGRESSION
.
141
H.3
GAUSSIAN
PROCESSES
FOR
CLASSIFICATION
.
141 |
| any_adam_object | 1 |
| author | Dietrich, Rainer 1970- |
| author_GND | (DE-588)123239486 |
| author_facet | Dietrich, Rainer 1970- |
| author_role | aut |
| author_sort | Dietrich, Rainer 1970- |
| author_variant | r d rd |
| building | Verbundindex |
| bvnumber | BV013927221 |
| ctrlnum | (OCoLC)50524123 (DE-599)BVBBV013927221 |
| format | Thesis Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>00000nam a22000008c 4500</leader><controlfield tag="001">BV013927221</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20121121</controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">010918s2001 gw d||| m||| 00||| eng d</controlfield><datafield tag="016" ind1="7" ind2=" "><subfield code="a">962376825</subfield><subfield code="2">DE-101</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">3826592794</subfield><subfield code="9">3-8265-9279-4</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)50524123</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV013927221</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakddb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="044" ind1=" " ind2=" "><subfield code="a">gw</subfield><subfield code="c">DE</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-20</subfield><subfield code="a">DE-703</subfield><subfield code="a">DE-355</subfield><subfield code="a">DE-188</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Dietrich, Rainer</subfield><subfield code="d">1970-</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)123239486</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Statistical mechanics of neural networks</subfield><subfield code="b">enhancement by weighting of examples</subfield><subfield code="c">Rainer Dietrich</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Aachen</subfield><subfield code="b">Shaker</subfield><subfield code="c">2001</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">IV, 150 S.</subfield><subfield code="b">graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="0" ind2=" "><subfield code="a">Berichte aus der Physik</subfield></datafield><datafield tag="502" ind1=" " ind2=" "><subfield code="a">Zugl.: Würzburg, Univ., Diss., 2000</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Statistische Mechanik</subfield><subfield code="0">(DE-588)4056999-8</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Neuronales Netz</subfield><subfield code="0">(DE-588)4226127-2</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Maschinelles Lernen</subfield><subfield code="0">(DE-588)4193754-5</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="655" ind1=" " ind2="7"><subfield code="0">(DE-588)4113937-9</subfield><subfield code="a">Hochschulschrift</subfield><subfield code="2">gnd-content</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Statistische Mechanik</subfield><subfield code="0">(DE-588)4056999-8</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Neuronales Netz</subfield><subfield code="0">(DE-588)4226127-2</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="2"><subfield code="a">Maschinelles Lernen</subfield><subfield code="0">(DE-588)4193754-5</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">DNB Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=009530733&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-009530733</subfield></datafield></record></collection> |
| genre | (DE-588)4113937-9 Hochschulschrift gnd-content |
| genre_facet | Hochschulschrift |
| id | DE-604.BV013927221 |
| illustrated | Illustrated |
| indexdate | 2024-08-23T00:43:22Z |
| institution | BVB |
| isbn | 3826592794 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-009530733 |
| oclc_num | 50524123 |
| open_access_boolean | |
| owner | DE-20 DE-703 DE-355 DE-BY-UBR DE-188 |
| owner_facet | DE-20 DE-703 DE-355 DE-BY-UBR DE-188 |
| physical | IV, 150 S. graph. Darst. |
| publishDate | 2001 |
| publishDateSearch | 2001 |
| publishDateSort | 2001 |
| publisher | Shaker |
| record_format | marc |
| series2 | Berichte aus der Physik |
| spelling | Dietrich, Rainer 1970- Verfasser (DE-588)123239486 aut Statistical mechanics of neural networks enhancement by weighting of examples Rainer Dietrich Aachen Shaker 2001 IV, 150 S. graph. Darst. txt rdacontent n rdamedia nc rdacarrier Berichte aus der Physik Zugl.: Würzburg, Univ., Diss., 2000 Statistische Mechanik (DE-588)4056999-8 gnd rswk-swf Neuronales Netz (DE-588)4226127-2 gnd rswk-swf Maschinelles Lernen (DE-588)4193754-5 gnd rswk-swf (DE-588)4113937-9 Hochschulschrift gnd-content Statistische Mechanik (DE-588)4056999-8 s Neuronales Netz (DE-588)4226127-2 s Maschinelles Lernen (DE-588)4193754-5 s DE-604 DNB Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=009530733&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Dietrich, Rainer 1970- Statistical mechanics of neural networks enhancement by weighting of examples Statistische Mechanik (DE-588)4056999-8 gnd Neuronales Netz (DE-588)4226127-2 gnd Maschinelles Lernen (DE-588)4193754-5 gnd |
| subject_GND | (DE-588)4056999-8 (DE-588)4226127-2 (DE-588)4193754-5 (DE-588)4113937-9 |
| title | Statistical mechanics of neural networks enhancement by weighting of examples |
| title_auth | Statistical mechanics of neural networks enhancement by weighting of examples |
| title_exact_search | Statistical mechanics of neural networks enhancement by weighting of examples |
| title_full | Statistical mechanics of neural networks enhancement by weighting of examples Rainer Dietrich |
| title_fullStr | Statistical mechanics of neural networks enhancement by weighting of examples Rainer Dietrich |
| title_full_unstemmed | Statistical mechanics of neural networks enhancement by weighting of examples Rainer Dietrich |
| title_short | Statistical mechanics of neural networks |
| title_sort | statistical mechanics of neural networks enhancement by weighting of examples |
| title_sub | enhancement by weighting of examples |
| topic | Statistische Mechanik (DE-588)4056999-8 gnd Neuronales Netz (DE-588)4226127-2 gnd Maschinelles Lernen (DE-588)4193754-5 gnd |
| topic_facet | Statistische Mechanik Neuronales Netz Maschinelles Lernen Hochschulschrift |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=009530733&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT dietrichrainer statisticalmechanicsofneuralnetworksenhancementbyweightingofexamples |