A semantic time framework for interactive media systems:
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Buch |
Sprache: | English |
Veröffentlicht: |
Göttingen
Cuvillier
2007
|
Ausgabe: | 1. Aufl. |
Schlagworte: | |
Online-Zugang: | Inhaltsverzeichnis |
Beschreibung: | Zugl.: Aachen, Techn. Hochsch., Diss., 2007 |
Beschreibung: | XXV, 231 S. Ill., graph. Darst. |
ISBN: | 9783867274364 |
Internformat
MARC
LEADER | 00000nam a2200000 c 4500 | ||
---|---|---|---|
001 | BV023294719 | ||
003 | DE-604 | ||
005 | 00000000000000.0 | ||
007 | t | ||
008 | 080508s2007 ad|| m||| 00||| eng d | ||
020 | |a 9783867274364 |9 978-3-86727-436-4 | ||
035 | |a (OCoLC)254717707 | ||
035 | |a (DE-599)BVBBV023294719 | ||
040 | |a DE-604 |b ger |e rakwb | ||
041 | 0 | |a eng | |
049 | |a DE-91 | ||
100 | 1 | |a Lee, Eric |e Verfasser |4 aut | |
245 | 1 | 0 | |a A semantic time framework for interactive media systems |c vorgelegt von Eric Lee |
250 | |a 1. Aufl. | ||
264 | 1 | |a Göttingen |b Cuvillier |c 2007 | |
300 | |a XXV, 231 S. |b Ill., graph. Darst. | ||
336 | |b txt |2 rdacontent | ||
337 | |b n |2 rdamedia | ||
338 | |b nc |2 rdacarrier | ||
500 | |a Zugl.: Aachen, Techn. Hochsch., Diss., 2007 | ||
655 | 7 | |0 (DE-588)4113937-9 |a Hochschulschrift |2 gnd-content | |
856 | 4 | 2 | |m DNB Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=016479279&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
999 | |a oai:aleph.bib-bvb.de:BVB01-016479279 |
Datensatz im Suchindex
_version_ | 1804137619945160704 |
---|---|
adam_text | IMAGE 1
CONTENTS
ABSTRACT X I X
UBERBLICK X X I
ACKNOWLEDGEMENTS XXIII
CONVENTIONS X X V
1 INTRODUCTION 1
1.1 MALLEABILITY OF TIME 2
1.2 SCOPE AND CONTEXT OF THIS THESIS 3
1.3 CONTRIBUTIONS 5
1.4 STRUCTURE 6
2 T I M E D E S I G N 9
2.1 A TIME-DESIGN SPACE ; 10
2.1.1 CONCEPTUAL VS. PHYSICAL INTERACTION 11
2.1.2 MULTIPLE TIME DOMAINS 15
2.2 USER: CONDUCTING GESTURE RECOGNITION 16
2.2.1 DESIGN 18
2.2.2 FEATURE DETECTORS 20
WIGGLE PROFILE 21
HTTP://D-NB.INFO/986778532
IMAGE 2
I.V CONTENTS
UP-DOWN PROFILE 21
FOUR-BEAT NEUTRAL-LEGATO PROFILE 22
2.2.3 PROFILE SELECTION 24
2.2.4 DISCUSSION 25
2.3 USER: RHYTHMIC ANALYSIS OF HUMAN MOTION 25
TERMINOLOGY 26
2.3.1 DESIGN 26
MOVEMENT DETECTION 27
INTERVAL ANALYSIS 27
FREQUENCY ANALYSIS 20
DATA FUSION 30
IMPULSE FOLDING 31
IMPULSE CLUSTERING 31
2.3.2 DISCUSSION 31
2.4 MEDIUM: MPEG-7 33
2.5 MEDIUM: AUTOMATIC BEAT DETECTION 34
2.6 TECHNOLOGY: VIDEO FRAME INTERPOLATION 37
2.7 TECHNOLOGY: AUDIO TIME-STRETCHING 40
2.7.1 BASIC PHASE VOCODER 42
2.7.2 SCALED PHASE-LOCKED PHASE VOCODER 44
2.7.3 T H E PHAVORIT ALGORITHM 45
MULTIRESOLUTION PEAK-PICKING (MRPP) 46
SINUSOIDAL TRAJECTORY HEURISTICS (STH) 47
SILENT PASSAGE PHASE RESET (SPPR.) 47
2.7.4 DISCUSSION 48
IMAGE 3
CONTENTS V
2.8 CLOSING REMARKS 49
3 T H E P R O B L E M O F MAPPINGS 5 1
3.1 BEAT TIMING IN CONDUCTING GESTURES 52
RELATED WORK 53
3.1.1 EXPERIMENT SCOPE AND OBJECTIVES 54
3.1.2 HYPOTHESES 55
3.1.3 EXPERIMENT. SETUP 57
PARTICIPANTS 58
PROCEDURE 58
3.1.4 RESULTS 59
CONDUCTORS VS. NON-CONDUCTORS 59
EFFECT OF CONDUCTING EXPERIENCE 60
EFFECT OF MUSICAL INSTRUMENT EXPERIENCE FIL
EFFECT OF A METAPHOR ON CONDUCTING 04
SUMMARY OF RESULTS 65
3.1.5 DISCUSSION 65
3.1.6 DESIGN IMPLICATIONS 68
3.2 RHYTHMIC CORRECTION 68
3.2.1 CONCEPT 69
3.2.2 EXPERIMENT 70
3.2.3 RESULTS 72
3.3 LATENCY IN AUDIO TIME-STRETCHING 73
3.3.1 INTERPRETING TIME-STRETCHED AUDIO 76
BLACK-BOX APPROACH 77
HOP-FACTOR APPROACH 77
IMAGE 4
VI CONTENTS
OVERLAP-ADD APPROACH 78
OTHER CONSIDERATIONS 80
3.3.2 STARTUP LATENCY 81
3.3.3 DYNAMIC LATENCY 83
3.3.4 DISCUSSION 85
3.4 SYNCHRONIZATION 85
3.4.1 A CLOSED LOOP SYSTEM 80
3.4.2 RESPONDING T O TIMEBASE CHANGES 88
3.4.3 DISCUSSION 90
3.5 CLOSING REMARKS 92
4 SEMANTIC T I M E 9 5
A CONCEPTUAL MODEL PROBLEM 90
4.1 RELATED WORK 96
4.2 TIME AS A HIERARCHY 99
4.3 SYNCHRONIZATION AS CONSTRAINTS 101
4.4 AN ALGEBRA FOR TIME 102
4.4.1 RHYTHM MAPS 103
4.4.2 CONCATENATION 104
4.4.3 SCALING 105
4.4.4 AVERAGING 107
4.4.5 ALGEBRAIC PROPERTIES 108
4.5 CLOSING REMARKS I L L
5 T H E SEMANTIC T I M E FRAMEWORK 1 1 3
5.1 DESIGN PRINCIPLES 117
IMAGE 5
CONTENTS VII
5.2 SEMANTIC TIME FRAMEWORK VERSION 1 (STFVL) 119
5.2.1 DESIGN 119
TIMEBASES 120
STREAMS 120
EFFECTS 120
GRAPHS 122
5.2.2 IMPLEMENTATION 124
5.2.3 DISCUSSION 124
5.3 SEMANTIC TIME FRAMEWORK VERSION 2 (STFV2) 126
5.3.1 DESIGN 127
TIME MAPS 128
NODES 128
PIPELINES 128
SYNCHRONIZERS 129
5.3.2 IMPLEMENTATION 130
5.3.3 DISCUSSION 131
5.3.4 EXAMPLE: H E L B S T F 132
5.3.5 EXAMPLE: METROSYNC 135
5.3.6 COMPARISON WITH OTHER FRAMEWORKS 137
5.4 CLOSING REMARKS 138
6 SAMPLE S Y S T E M S 141
0.1 PERSONAL ORCHESTRA 142
6.1.1 PERSONAL ORCHESTRA 1 (THE VIRTUAL CONDUCTOR) . . . 144
6.1.2 PERSONAL ORCHESTRA 2 ( YOU IV. THE CONDUCTOR) . . . . 147
6.1.3 PERSONAL ORCHESTRA 3 {MAESTRO!) 148
IMAGE 6
VIII CONTENTS
6.1.4 POLITE 152
6.1.5 DISCUSSION AND FUTURE DIRECTIONS 155
6.2 DIMAFI 155
6.2.1 DESIGN 159
6.2.2 AN IMPROVED SYNCHRONIZATION ALGORITHM 161
G.2.3 FORWARDS AND BACKWARDS SCRUBBING 164
6.2.4 BEAT TAPPER 164
6.2.5 DISCUSSION AND FUTURE DIRECTIONS 166
6.3 IRHYME 167
6.3.1 QUARTZ COMPOSER 168
6.3.2 IMPLEMENTATION 169
6.3.3 DISCUSSION 170
6.4 CLOSING REMARKS 170
7 FUTURE W O R K 1 7 3
7.1 TIME-DESIGN SPACE 173
7.2 SEMANTIC TIME 174
7.3 SEMANTIC TIME FRAMEWORK 175
7.4 DESIGN PATTERNS 176
7.5 SEMANTIC TIME APPLICATIONS 176
8 CONCLUSIONS 1 7 9
A SAMPLING A N D QUANTIZATION OVERVIEW 1 8 3
A.L SAMPLING 183
A.2 QUANTIZATION 184
A.3 RESAMPLING 185
IMAGE 7
CONTENTS IX
A.4 CLOSING REMARKS 192
B FOURIER T H E O R Y OVERVIEW 1 9 3
B.L T H E FOURIER TRANSFORM 193
B.2 WINDOWING 194
B.U T H E SHORT-TIME FOURIER TRANSFORM 195
B.4 CLOSING REMARKS 196
C SOURCE C O D E LISTINGS 1 9 7
C . L HELLOSTF 197
C . L . L HCLLOSTFCONTROLLER.H 197
C.1.2 HELLOSTFCONTROLLER.NL 199
C.2 METROSYNC 202
C.2.1 METRONOMEVIEW.IL 202
C.2.2 METRONOMEVIEW.IN 204
BIBLIOGRAPHY 2 0 9
I N D E X 2 2 7
CURRICULUM V I T A E 2 3 1
|
adam_txt |
IMAGE 1
CONTENTS
ABSTRACT X I X
UBERBLICK X X I
ACKNOWLEDGEMENTS XXIII
CONVENTIONS X X V
1 INTRODUCTION 1
1.1 MALLEABILITY OF TIME 2
1.2 SCOPE AND CONTEXT OF THIS THESIS 3
1.3 CONTRIBUTIONS 5
1.4 STRUCTURE 6
2 T I M E D E S I G N 9
2.1 A TIME-DESIGN SPACE ; 10
2.1.1 CONCEPTUAL VS. PHYSICAL INTERACTION 11
2.1.2 MULTIPLE TIME DOMAINS 15
2.2 USER: CONDUCTING GESTURE RECOGNITION 16
2.2.1 DESIGN 18
2.2.2 FEATURE DETECTORS 20
WIGGLE PROFILE 21
HTTP://D-NB.INFO/986778532
IMAGE 2
I.V CONTENTS
UP-DOWN PROFILE 21
FOUR-BEAT NEUTRAL-LEGATO PROFILE 22
2.2.3 PROFILE SELECTION 24
2.2.4 DISCUSSION 25
2.3 USER: RHYTHMIC ANALYSIS OF HUMAN MOTION 25
TERMINOLOGY 26
2.3.1 DESIGN 26
MOVEMENT DETECTION 27
INTERVAL ANALYSIS 27
FREQUENCY ANALYSIS 20
DATA FUSION 30
IMPULSE FOLDING 31
IMPULSE CLUSTERING 31
2.3.2 DISCUSSION 31
2.4 MEDIUM: MPEG-7 33
2.5 MEDIUM: AUTOMATIC BEAT DETECTION 34
2.6 TECHNOLOGY: VIDEO FRAME INTERPOLATION 37
2.7 TECHNOLOGY: AUDIO TIME-STRETCHING 40
2.7.1 BASIC PHASE VOCODER 42
2.7.2 SCALED PHASE-LOCKED PHASE VOCODER 44
2.7.3 T H E PHAVORIT ALGORITHM 45
MULTIRESOLUTION PEAK-PICKING (MRPP) 46
SINUSOIDAL TRAJECTORY HEURISTICS (STH) 47
SILENT PASSAGE PHASE RESET (SPPR.) 47
2.7.4 DISCUSSION 48
IMAGE 3
CONTENTS V
2.8 CLOSING REMARKS 49
3 T H E P R O B L E M O F MAPPINGS 5 1
3.1 BEAT TIMING IN CONDUCTING GESTURES 52
RELATED WORK 53
3.1.1 EXPERIMENT SCOPE AND OBJECTIVES 54
3.1.2 HYPOTHESES 55
3.1.3 EXPERIMENT. SETUP 57
PARTICIPANTS 58
PROCEDURE 58
3.1.4 RESULTS 59
CONDUCTORS VS. NON-CONDUCTORS 59
EFFECT OF CONDUCTING EXPERIENCE 60
EFFECT OF MUSICAL INSTRUMENT EXPERIENCE FIL
EFFECT OF A METAPHOR ON CONDUCTING 04
SUMMARY OF RESULTS 65
3.1.5 DISCUSSION 65
3.1.6 DESIGN IMPLICATIONS 68
3.2 RHYTHMIC CORRECTION 68
3.2.1 CONCEPT 69
3.2.2 EXPERIMENT 70
3.2.3 RESULTS 72
3.3 LATENCY IN AUDIO TIME-STRETCHING 73
3.3.1 INTERPRETING TIME-STRETCHED AUDIO 76
BLACK-BOX APPROACH 77
HOP-FACTOR APPROACH 77
IMAGE 4
VI CONTENTS
OVERLAP-ADD APPROACH 78
OTHER CONSIDERATIONS 80
3.3.2 STARTUP LATENCY 81
3.3.3 DYNAMIC LATENCY 83
3.3.4 DISCUSSION 85
3.4 SYNCHRONIZATION 85
3.4.1 A CLOSED LOOP SYSTEM 80
3.4.2 RESPONDING T O TIMEBASE CHANGES 88
3.4.3 DISCUSSION 90
3.5 CLOSING REMARKS 92
4 SEMANTIC T I M E 9 5
A CONCEPTUAL MODEL PROBLEM 90
4.1 RELATED WORK 96
4.2 TIME AS A HIERARCHY 99
4.3 SYNCHRONIZATION AS CONSTRAINTS 101
4.4 AN ALGEBRA FOR TIME 102
4.4.1 RHYTHM MAPS 103
4.4.2 CONCATENATION 104
4.4.3 SCALING 105
4.4.4 AVERAGING 107
4.4.5 ALGEBRAIC PROPERTIES 108
4.5 CLOSING REMARKS I L L
5 T H E SEMANTIC T I M E FRAMEWORK 1 1 3
5.1 DESIGN PRINCIPLES 117
IMAGE 5
CONTENTS VII
5.2 SEMANTIC TIME FRAMEWORK VERSION 1 (STFVL) 119
5.2.1 DESIGN 119
TIMEBASES 120
STREAMS 120
EFFECTS 120
GRAPHS 122
5.2.2 IMPLEMENTATION 124
5.2.3 DISCUSSION 124
5.3 SEMANTIC TIME FRAMEWORK VERSION 2 (STFV2) 126
5.3.1 DESIGN 127
TIME MAPS 128
NODES 128
PIPELINES 128
SYNCHRONIZERS 129
5.3.2 IMPLEMENTATION 130
5.3.3 DISCUSSION 131
5.3.4 EXAMPLE: H E L B S T F 132
5.3.5 EXAMPLE: METROSYNC 135
5.3.6 COMPARISON WITH OTHER FRAMEWORKS 137
5.4 CLOSING REMARKS 138
6 SAMPLE S Y S T E M S 141
0.1 PERSONAL ORCHESTRA 142
6.1.1 PERSONAL ORCHESTRA 1 (THE VIRTUAL CONDUCTOR) . . . 144
6.1.2 PERSONAL ORCHESTRA 2 ( YOU IV. THE CONDUCTOR) . . . . 147
6.1.3 PERSONAL ORCHESTRA 3 {MAESTRO!) 148
IMAGE 6
VIII CONTENTS
6.1.4 POLITE 152
6.1.5 DISCUSSION AND FUTURE DIRECTIONS 155
6.2 DIMAFI 155
6.2.1 DESIGN 159
6.2.2 AN IMPROVED SYNCHRONIZATION ALGORITHM 161
G.2.3 FORWARDS AND BACKWARDS SCRUBBING 164
6.2.4 BEAT TAPPER 164
6.2.5 DISCUSSION AND FUTURE DIRECTIONS 166
6.3 IRHYME 167
6.3.1 QUARTZ COMPOSER 168
6.3.2 IMPLEMENTATION 169
6.3.3 DISCUSSION 170
6.4 CLOSING REMARKS 170
7 FUTURE W O R K 1 7 3
7.1 TIME-DESIGN SPACE 173
7.2 SEMANTIC TIME 174
7.3 SEMANTIC TIME FRAMEWORK 175
7.4 DESIGN PATTERNS 176
7.5 SEMANTIC TIME APPLICATIONS 176
8 CONCLUSIONS 1 7 9
A SAMPLING A N D QUANTIZATION OVERVIEW 1 8 3
A.L SAMPLING 183
A.2 QUANTIZATION 184
A.3 RESAMPLING 185
IMAGE 7
CONTENTS IX
A.4 CLOSING REMARKS 192
B FOURIER T H E O R Y OVERVIEW 1 9 3
B.L T H E FOURIER TRANSFORM 193
B.2 WINDOWING 194
B.U T H E SHORT-TIME FOURIER TRANSFORM 195
B.4 CLOSING REMARKS 196
C SOURCE C O D E LISTINGS 1 9 7
C . L HELLOSTF 197
C . L . L HCLLOSTFCONTROLLER.H 197
C.1.2 HELLOSTFCONTROLLER.NL 199
C.2 METROSYNC 202
C.2.1 METRONOMEVIEW.IL 202
C.2.2 METRONOMEVIEW.IN 204
BIBLIOGRAPHY 2 0 9
I N D E X 2 2 7
CURRICULUM V I T A E 2 3 1 |
any_adam_object | 1 |
any_adam_object_boolean | 1 |
author | Lee, Eric |
author_facet | Lee, Eric |
author_role | aut |
author_sort | Lee, Eric |
author_variant | e l el |
building | Verbundindex |
bvnumber | BV023294719 |
ctrlnum | (OCoLC)254717707 (DE-599)BVBBV023294719 |
edition | 1. Aufl. |
format | Book |
fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01137nam a2200301 c 4500</leader><controlfield tag="001">BV023294719</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">00000000000000.0</controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">080508s2007 ad|| m||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9783867274364</subfield><subfield code="9">978-3-86727-436-4</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)254717707</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV023294719</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-91</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Lee, Eric</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">A semantic time framework for interactive media systems</subfield><subfield code="c">vorgelegt von Eric Lee</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">1. Aufl.</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Göttingen</subfield><subfield code="b">Cuvillier</subfield><subfield code="c">2007</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XXV, 231 S.</subfield><subfield code="b">Ill., graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">Zugl.: Aachen, Techn. Hochsch., Diss., 2007</subfield></datafield><datafield tag="655" ind1=" " ind2="7"><subfield code="0">(DE-588)4113937-9</subfield><subfield code="a">Hochschulschrift</subfield><subfield code="2">gnd-content</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">DNB Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=016479279&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-016479279</subfield></datafield></record></collection> |
genre | (DE-588)4113937-9 Hochschulschrift gnd-content |
genre_facet | Hochschulschrift |
id | DE-604.BV023294719 |
illustrated | Illustrated |
index_date | 2024-07-02T20:44:26Z |
indexdate | 2024-07-09T21:15:11Z |
institution | BVB |
isbn | 9783867274364 |
language | English |
oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-016479279 |
oclc_num | 254717707 |
open_access_boolean | |
owner | DE-91 DE-BY-TUM |
owner_facet | DE-91 DE-BY-TUM |
physical | XXV, 231 S. Ill., graph. Darst. |
publishDate | 2007 |
publishDateSearch | 2007 |
publishDateSort | 2007 |
publisher | Cuvillier |
record_format | marc |
spelling | Lee, Eric Verfasser aut A semantic time framework for interactive media systems vorgelegt von Eric Lee 1. Aufl. Göttingen Cuvillier 2007 XXV, 231 S. Ill., graph. Darst. txt rdacontent n rdamedia nc rdacarrier Zugl.: Aachen, Techn. Hochsch., Diss., 2007 (DE-588)4113937-9 Hochschulschrift gnd-content DNB Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=016479279&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
spellingShingle | Lee, Eric A semantic time framework for interactive media systems |
subject_GND | (DE-588)4113937-9 |
title | A semantic time framework for interactive media systems |
title_auth | A semantic time framework for interactive media systems |
title_exact_search | A semantic time framework for interactive media systems |
title_exact_search_txtP | A semantic time framework for interactive media systems |
title_full | A semantic time framework for interactive media systems vorgelegt von Eric Lee |
title_fullStr | A semantic time framework for interactive media systems vorgelegt von Eric Lee |
title_full_unstemmed | A semantic time framework for interactive media systems vorgelegt von Eric Lee |
title_short | A semantic time framework for interactive media systems |
title_sort | a semantic time framework for interactive media systems |
topic_facet | Hochschulschrift |
url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=016479279&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
work_keys_str_mv | AT leeeric asemantictimeframeworkforinteractivemediasystems |