E-Book, Englisch, 376 Seiten
Waibel / Karat / Stiefelhagen Computers in the Human Interaction Loop
1. Auflage 2009
ISBN: 978-1-84882-054-8
Verlag: Springer
Format: PDF
Kopierschutz: 1 - PDF Watermark
E-Book, Englisch, 376 Seiten
Reihe: Human-Computer Interaction Series
ISBN: 978-1-84882-054-8
Verlag: Springer
Format: PDF
Kopierschutz: 1 - PDF Watermark
This book integrates a wide range of research topics related to and necessary for the development of proactive, smart, computers in the human interaction loop, including the development of audio-visual perceptual components for such environments; the design, implementation and analysis of novel proactive perceptive services supporting humans; the development of software architectures, ontologies and tools necessary for building such environments and services, as well as approaches for the evaluation of such technologies and services. The book is based on a major European Integrated Project, CHLI (Computers in the Human Interaction Loop), and throws light on the paradigm shift in the area of HCI that rather than humans interactive directly with machines, computers should observe and understand human interaction, and support humans during their work and interaction in an implicit and proactive manner.
Autoren/Hrsg.
Weitere Infos & Material
1;Preface;6
1.1;The CHIL Consortium;8
1.2;Acknowledgments;9
2;Contents;14
3;List of Figures;17
4;List of Tables;20
5;The CHIL Vision and Framework;22
5.1;1 Computers in the Human Interaction Loop;23
6;Perceptual Technologies;27
6.1;2 Perceptual Technologies: Analyzing the Who, What, Where of Human Interaction;28
6.2;3 Person Tracking;30
6.2.1;3.1 Goals and Challenges;31
6.2.2;3.2 Difficulties and Lessons Learned;33
6.2.3;3.3 Results and Highlights;34
6.2.4;References;39
6.3;4 Multimodal Person Identification;42
6.3.1;4.1 Speaker Identification;44
6.3.2;4.2 Face Identification;44
6.3.3;4.3 Multimodal Person Identification;47
6.3.4;4.4 Lessons Learned;47
6.3.5;References;49
6.4;5 Estimation of Head Pose;51
6.4.1;5.1 Single-Camera Head Pose Estimation;52
6.4.2;5.2 Multicamera Head Pose Estimation;54
6.4.3;5.3 Conclusion and Future Work;58
6.4.4;References;59
6.5;6 Automatic Speech Recognition;61
6.5.1;6.1 The ASR Framework in CHIL;62
6.5.2;6.2 ASR Preprocessing Steps;64
6.5.3;6.3 Main ASR Techniques and Highlights;66
6.5.4;6.4 An ASR System Example;70
6.5.5;6.5 Experimental Results;72
6.5.6;6.6 Conclusions and Discussion;73
6.5.7;References;74
6.6;7 Acoustic Event Detection and Classification;78
6.6.1;7.1 Acoustic Event Classification;79
6.6.2;7.2 Acoustic Event Detection;83
6.6.3;7.3 Demonstrations of Acoustic Event Detection;88
6.6.4;7.4 Conclusions and Remaining Challenges;90
6.6.5;References;90
6.7;8 Language Technologies: Question Answering in Speech Transcripts;91
6.7.1;8.1 Question Answering;92
6.7.2;8.2 Question Answering: From Written to Spoken Language;93
6.7.3;8.3 Fast Question Answering;95
6.7.4;8.4 The QAST 2007 Evaluation;98
6.7.5;8.5 Conclusions and Discussion;101
6.7.6;References;102
6.8;9 Extracting Interaction Cues: Focus of Attention, Body Pose, and Gestures;103
6.8.1;9.1 From Head Pose to Focus of Attention;104
6.8.2;9.2 Determining Focus of Attention in Dynamic Environments;105
6.8.3;9.3 Tracking Body Pose;106
6.8.4;9.4 Pointing Gesture and Hand-Raising Detection;107
6.8.5;9.5 Detection of Fine-Scale Gestures;108
6.8.6;References;109
6.9;10 Emotion Recognition;110
6.9.1;10.1 Emotion Recognition for the Socially Supportive Workspaces Scenario;111
6.9.2;10.2 Emotion Recognition for the Connector Agent Scenario;114
6.9.3;10.3 Discussion;117
6.9.4;10.4 Conclusion;120
6.9.5;References;120
6.10;11 Activity Classification;121
6.10.1;11.1 Visual Activities Recognition in a Smart-Room Environment Using a Probabilistic Syntactic Approach;122
6.10.2;11.2 Person Activity Classification Using Gestures;123
6.10.3;11.3 Activity Recognition and Room-Level Tracking in an Office Environment;128
6.10.4;11.4 Conclusion;131
6.10.5;References;132
6.11;12 Situation Modeling;134
6.11.1;12.1 Defining Concepts: Role, Relation, Situation, and Situation Network;135
6.11.2;12.2 Implementations of the Situation Model;138
6.11.3;12.3 Perspective: Automatic Acquisition and Adaptation of Situation Models Based on User Feedback;143
6.11.4;12.4 Conclusion;143
6.11.5;References;144
6.12;13 Targeted Audio;146
6.12.1;References;154
6.13;14 Multimodal Interaction Control;155
6.13.1;14.1 Interaction Control in Spoken Dialog Systems;156
6.13.2;14.2 Multimodal Output and Interaction Control;162
6.13.3;References;167
6.14;15 Perceptual Component Evaluation and Data Collection;170
6.14.1;15.1 CHIL Data Overview;172
6.14.2;15.2 CHIL Corpus Annotations;180
6.14.3;15.3 CHIL Evaluations Overview;183
6.14.4;15.4 Conclusions;186
6.14.5;References;186
7;Services;188
7.1;16 User-Centered Design of CHIL Services: Introduction;189
7.1.1;16.1 Methodology;192
7.1.2;16.2 Methodological Issues;193
7.1.3;16.3 Overview of Part III;194
7.1.4;References;195
7.2;17 The Collaborative Workspace: A Co-located Tabletop Device to Support Meetings;197
7.2.1;17.1 RelatedWork;198
7.2.2;17.2 User-Centered Design of a Tabletop Interface;201
7.2.3;17.3 Initial User Study: Whiteboard as Mock-up;201
7.2.4;17.4 The Collaborative Workspace: First Design;206
7.2.5;17.5 The Second User Study;207
7.2.6;17.6 Re-Thinking the CollaborativeWorkspace;210
7.2.7;17.7 The Collaborative Workspace: Second Design;211
7.2.8;17.8 The Third User Study;211
7.2.9;References;214
7.3;18 The Memory Jog Service;216
7.3.1;18.1 The AIT Memory Jog Service for Meeting, Lecture and Presentation Support;216
7.3.2;18.2 The UPC Memory Jog Service;229
7.3.3;References;242
7.4;19 The Connector Service: Representing Availability for Mobile Communication;244
7.4.1;19.1 The Always-OnWorld: Benefits and Burdens of Mobile Communication;244
7.4.2;19.2 The Connector: Representing the Receiver’s Plans to the Sender;245
7.4.3;19.3 Situated Aspects of Availability;249
7.4.4;19.4 New Communication Modalities: Implicit Availability Representations;258
7.4.5;19.5 Conclusions;262
7.4.6;References;264
7.5;20 Relational Cockpit;266
7.5.1;20.1 Prototype;267
7.5.2;20.2 Evaluation;270
7.5.3;20.3 Results;273
7.5.4;20.4 Conclusion and Lessons Learned;276
7.5.5;References;278
7.6;21 Automatic Relational Reporting to Support Group Dynamics;280
7.6.1;21.1 Background and RelatedWork;280
7.6.2;21.2 The Survival Task Experiment;282
7.6.3;21.3 The Functional Role-Coding Scheme;283
7.6.4;21.4 The Survival Task Corpus;285
7.6.5;21.5 Automatic Detection of Functional Roles;285
7.6.6;21.6 From Coding Scheme to Relational Reports;286
7.6.7;21.7 Conclusion;288
7.6.8;References;289
8;The CHIL Reference Architecture;291
8.1;22 Introduction;292
8.1.1;22.1 Motivation for the CHIL Software Architecture;292
8.1.2;22.2 RelatedWork;293
8.1.3;22.3 Benefits of the CHIL Reference Architecture;294
8.1.4;22.4 The CHIL Architecture and the Demands of Perceptual Systems;294
8.1.5;22.5 Overview of Part IV Chapters;295
8.1.6;References;297
8.2;23 The CHIL Reference Model Architecture for Multimodal Perceptual Systems;298
8.2.1;23.1 The CHIL Layer Model;298
8.2.2;23.2 Brief Layer Description;299
8.3;24 Low-Level Distributed Data Transfer Layer: The ChilFlow Middleware;304
8.3.1;24.1 Flows;305
8.3.2;24.2 ChilFlow’s Architecture;307
8.3.3;24.3 Programming Interface;308
8.3.4;24.4 Comparison with the NIST Smart Data Flow System;311
8.3.5;References;312
8.4;25 Perceptual Component Data Models and APIs;313
8.4.1;25.1 Plug-and-Play Perceptual Components;313
8.4.2;25.2 The CHIL Compliance;314
8.4.3;25.3 Data Models and Interfaces;315
8.4.4;25.4 Body Tracker Exchange Experience;317
8.5;26 Situation Modeling Layer;320
8.5.1;26.1 Principles of Situation Modeling;321
8.5.2;26.2 Perspective of Situation Modeling Developers;323
8.5.3;26.3 Architecture and Key Abstractions;325
8.5.4;26.4 Situation Modeling Framework;327
8.5.5;References;329
8.6;27 Ontological Modeling and Reasoning;330
8.6.1;27.1 The CHIL Ontology;332
8.6.2;27.2 The CHIL OWL API;335
8.6.3;27.3 The Zhi# Programming Language;338
8.6.4;27.4 Conclusion;343
8.6.5;References;344
8.7;28 Building Scalable Services: The CHIL Agent Framework;346
8.7.1;28.1 The CHIL Agent Infrastructure;346
8.7.2;28.2 Intelligent Messaging;350
8.7.3;28.3 Pluggable Behaviors;351
8.7.4;28.4 Scalable Services;352
8.7.5;28.5 Autonomy;354
8.7.6;28.6 Directory Service;356
8.7.7;28.7 Conclusion;356
8.7.8;References;356
8.8;29 CHIL Integration Tools and Middleware;358
8.8.1;29.1 SITCOM: Situation Composer;359
8.8.2;29.2 CHiLiX: The Eventing Middleware for Context-aware Applications;363
8.8.3;29.3 Designing with SITCOM: Connector Service Scenario;364
8.8.4;29.4 Conclusion;367
8.8.5;References;369
9;Beyond CHIL;370
9.1;30 Beyond CHIL;371
9.1.1;30.1 Perceptual Technologies;371
9.1.2;30.2 CHIL, A Family of Services;374
9.1.3;30.3 From CHIL to CHHIL Services;374
10;Index;376
