Djeraba / Lablack / Benabbas Multi-Modal User Interactions in Controlled Environments

1. Auflage 2010
ISBN: 978-1-4419-0316-7
Verlag: Springer
Format: PDF
Kopierschutz: 1 - PDF Watermark

E-Book, Englisch, Band 34, 216 Seiten

Reihe: Multimedia Systems and Applications

Multi-Modal User Interactions in Controlled Environments investigates the capture and analysis of user's multimodal behavior (mainly eye gaze, eye fixation, eye blink and body movements) within a real controlled environment (controlled-supermarket, personal environment) in order to adapt the response of the computer/environment to the user. Such data is captured using non-intrusive sensors (for example, cameras in the stands of a supermarket) installed in the environment. This multi-modal video based behavioral data will be analyzed to infer user intentions while assisting users in their day-to-day tasks by adapting the system's response to their requirements seamlessly. This book also focuses on the presentation of information to the user. Multi-Modal User Interactions in Controlled Environments is designed for professionals in industry, including professionals in the domains of security and interactive web television. This book is also suitable for graduate-level students in computer science and electrical engineering.

Autoren/Hrsg.

Djeraba, Chaabane

Djeraba, Chabane

Lablack, Adel

Benabbas, Yassine

Inhaltsverzeichnis

1;Foreword;7
2;Preface;8
3;Acknowledgements;10
4;Contents;11
5;Chapter 1 ntroduction;14
5.1;1.1 Introduction;14
5.2;1.2 Objective;15
5.3;1.3 Practical Applications;16
5.4;1.4 Research Challenges;18
5.4.1;1.4.1 Event Detection;18
5.4.2;1.4.2 Flow Estimation;18
5.4.3;1.4.3 Gaze Estimation;19
5.4.4;1.4.4 Role of the Context;19
5.4.5;1.4.5 Societal Issues;20
5.5;1.5 Technical Contribution;20
5.6;1.6 How the Book is Organized;22
6;Chapter 2 Abnormal Event Detection;24
6.1;2.1 Introduction;24
6.2;2.2 Related Work;26
6.3;2.3 Proposed Approach;28
6.3.1;2.3.1 Low-Level Features;29
6.3.1.1;2.3.1.1 Motion Heat Map;29
6.3.1.2;2.3.1.2 Points of Interest;30
6.3.1.3;2.3.1.3 Tracking Points of Interest;32
6.3.1.4;2.3.1.4;33
6.3.2;2.3.2 Intermediate-Level Features;34
6.3.2.1;2.3.2.1 Motion Area Ratio;34
6.3.2.2;2.3.2.2 Direction Variance;35
6.3.2.3;2.3.2.3 Motion Magnitude Variance;35
6.3.2.4;2.3.2.4 Direction Histogram;35
6.3.2.5;2.3.2.5 Direction Map;36
6.3.2.6;2.3.2.6 Difference of Direction Map;37
6.3.3;2.3.3 Other Intermediate-Level Features;39
6.3.3.1;2.3.3.1 Motion Continuity Factor;39
6.3.3.2;2.3.3.2 Motion Description Factor;42
6.3.3.3;2.3.3.3 Motion Trajectory of the Blob;44
6.3.4;2.3.4 High-Level Features;46
6.3.4.1;2.3.4.1 Detecting Collapsing Events;46
6.3.4.2;2.3.4.2 Detecting Opposing Flow Event;49
6.4;2.4 Group Detection and Tracking;51
6.4.1;2.4.1 Detection and Tracking of PoIs;52
6.4.2;2.4.2 Direction and Magnitude Models;53
6.4.3;2.4.3 Block Clustering;54
6.4.4;2.4.4 Group Tracking;55
6.5;2.5 Detecting Multiple Flows and Events in a Crowd Scene;56
6.5.1;2.5.1 Multiple Flow Detection;56
6.5.2;2.5.2 Event Recognition;56
6.5.3;2.5.3 Running and Walking Events;57
6.5.4;2.5.4 Crowd Convergence and Divergence Events;57
6.5.5;2.5.5 Results;59
6.6;2.6 Method Adaptation to Context;61
6.6.1;2.6.1 Overview;61
6.6.2;2.6.2 Context Factors;61
6.6.3;2.6.3 Method Extensions;63
6.6.4;2.6.4 Experiments;64
6.6.4.1;2.6.4.1 Some examples;64
6.6.4.2;2.6.4.2 Data Set;64
6.6.4.3;2.6.4.3 Methodology;66
6.6.5;2.6.5 Results;68
6.7;2.7 Conclusion;69
7;Chapter 3 Flow Estimation;72
7.1;3.1 Introduction;72
7.2;3.2 Related Works;73
7.2.1;3.2.1 Methods based on Motion Detection and Analysis;74
7.2.1.1;3.2.1.1 Approach Proposed by Xu and al. [149];75
7.2.1.2;3.2.1.2 Approach Proposed by Zhang and Chen [153];76
7.2.2;3.2.2 Methods Based on Contour Analysis;80
7.2.2.1;3.2.2.1 Approach Proposed by Bozzoli and al. [19];80
7.2.3;3.2.3 Template-Based Methods;85
7.2.3.1;3.2.3.1 Approach Proposed by Sidla and al. [120];86
7.2.4;3.2.4 Stereovision-Based methods;88
7.2.4.1;3.2.4.1 Approach Proposed by Terada and al. [130];89
7.2.5;3.2.5 Spatio-Temporal Methods;92
7.2.5.1;3.2.5.1 Approach Proposed by Albiol and al. [1];94
7.2.6;3.2.6 Commercial Applications;96
7.2.6.1;3.2.6.1 Cognimatics;96
7.2.6.2;3.2.6.2 Infodev;97
7.2.6.3;3.2.6.3 Eurecam Sarl;98
7.2.7;3.2.7 Contribution;98
7.3;3.3 Approach Steps;99
7.3.1;3.3.1 Blob Detection;99
7.3.2;3.3.2 Count Estimation;104
7.4;3.4 Experiments and Results;106
7.5;3.5 Conclusion;110
8;Chapter 4 Estimation of Visual Gaze;112
8.1;4.1 Human Vision System;112
8.2;4.2 History of Gaze Tracking;114
8.3;4.3 Gaze Tracking Techniques;115
8.3.1;4.3.1 Intrusive Systems;115
8.3.1.1;4.3.1.1 Electro-Oculography;115
8.3.1.2;4.3.1.2 Contact Lenses with Magnetic Coils;115
8.3.1.3;4.3.1.3 Localization of the Limb;116
8.3.1.4;4.3.1.4 Analysis of Eye Images;116
8.3.2;4.3.2 Non-Intrusive Systems;119
8.4;4.4 Applications;119
8.4.1;4.4.1 Interaction During Meetings;119
8.4.2;4.4.2 Driver Monitoring;120
8.4.3;4.4.3 Virtual Reality;120
8.4.4;4.4.4 Human Computer Interaction;121
8.4.5;4.4.5 Extraction of Saliency Maps in Images;122
8.4.6;4.4.6 Store Marketing;123
8.5;4.5 Contribution of Head Pose in Visual Gaze;123
8.5.1;4.5.1 Database;124
8.5.2;4.5.2 Calculating the Contribution of Head Pose;125
8.5.3;4.5.3 Prediction of the Target;125
8.6;4.6 Estimating Gaze Direction Based on Eye Localization Only;127
8.7;4.7 Head Pose Estimation;127
8.7.1;4.7.1 State of the Art;128
8.7.1.1;4.7.1.1 Definition;128
8.7.1.2;4.7.1.2 Human Capacity for Estimating Head Orientation;129
8.7.1.3;4.7.1.3 Problems Encountered when Estimating Head Poses;131
8.7.2;4.7.2 Image Datasets;140
8.7.2.1;4.7.2.1 Building Image Datasets;140
8.7.2.2;4.7.2.2 Utilized Image Database;142
8.7.3;4.7.3 Estimation of Head Pose Based on Global Appearance;144
8.7.3.1;4.7.3.1 Utilized Image Dataset;144
8.7.3.2;4.7.3.2 Feature Selection;145
8.7.3.3;4.7.3.3 Experimental Results;150
8.7.4;4.7.4 Cylindrical Model for Head Tracking;151
8.8;4.8 Conclusion;154
9;Chapter 5 Visual Field Projection and Region of Interest Analysis;156
9.1;5.1 Visual Field Estimation;156
9.1.1;5.1.1 Physiological Data;157
9.1.2;5.1.2 Visual Field Estimation and Fixation Point for Frontal Pose;158
9.1.3;5.1.3 Visual Field Adaptation to Head Orientation;160
9.1.3.1;5.1.3.1 Matrix Approach;161
9.2;5.2 Visual Field Projection;166
9.2.1;5.2.1 Point Projection;166
9.2.2;5.2.2 Perception Volume Projection;168
9.3;5.3 Visual Field Display and Projection on an Image;170
9.4;5.4 Region-of-Interest Extraction;172
9.4.1;5.4.1 Representation of Gaze Information;172
9.4.2;5.4.2 Gaze Point Correction;173
9.4.3;5.4.3 Calculation of Tilt and Pan Angles Corresponding to a Gaze Point;175
9.5;5.5 Metrics for Gaze Analysis;176
9.5.1;5.5.1 Construction of a System Measuring Media Relevance;176
9.5.1.1;5.5.1.1 Raw Data Collection;177
9.5.1.2;5.5.1.2 Identification of Fixations;177
9.5.2;5.5.2 Metrics Related to Fixation Distribution;178
9.5.3;5.5.3 Experiment;180
9.5.3.1;5.5.3.1 Images;180
9.5.3.2;5.5.3.2 Videos;181
9.5.4;5.5.4 Discussions;182
9.6;5.6 Conclusion;183
10;Chapter 6 Conclusion;184
10.1;6.1 Challenge;184
10.2;6.2 Perspectives;185
11;References;188
12;Appendix A Societal Recommendations;200
12.1;A.1 Societal Recommendations;201
12.1.1;A.1.1 Public Awareness;201
12.1.1.1;A.1.1.1 Observation and Surveillance Technology Awareness;201
12.1.1.2;A.1.1.2 Legal Awareness;202
12.1.1.3;A.1.1.3 Recommendation 1;202
12.1.2;A.1.2 Public Policy of Research and Development;202
12.1.2.1;A.1.2.1 EU R&D Awareness;202
12.1.2.2;A.1.2.2 Recommendation 2;203
12.1.2.3;A.1.2.3 Democratic Discussion;203
12.1.2.4;A.1.2.4 Recommendation 3;204
12.1.2.5;A.1.2.5 R&D Program Evaluation;204
12.1.2.6;A.1.2.6 Recommendation 4;204
12.1.2.7;A.1.2.7 Management and Human Science Researchers’ Role;205
12.1.2.8;A.1.2.8 Recommendation 5;205
12.1.3;A.1.3 Democratic Requirement for OST Regulation;205
12.1.3.1;A.1.3.1 Reinforcement of Public Authorities’ Assets with Regard to the Protection of Privacy and Data Protection;205
12.1.3.2;A.1.3.2 Recommendation 6;206
12.1.3.3;A.1.3.3 Intelligibility of the OST Systems;206
12.1.3.4;A.1.3.4 Accessibility to the OST Systems;206
12.1.3.5;A.1.3.5 Recommendation 7;207
12.1.3.6;A.1.3.6 Legitimacy of the OST’s Finalities;207
12.1.3.7;A.1.3.7 Recommendation 8;207
12.1.3.8;A.1.3.8 Recommendation 9;207
12.1.3.9;A.1.3.9 Privatization of Public Issues;208
12.1.3.10;A.1.3.10 Recommendation 10;208
12.2;A.2 Legal Recommendations;208
12.2.1;A.2.1 Data Protection and Privacy Issues;208
12.2.1.1;A.2.1.1 Recommendation 11;208
12.2.1.2;A.2.1.2 Recommendation 12;209
12.2.1.3;A.2.1.3 Recommendation 13;209
12.2.1.4;A.2.1.4 Recommendation 14;209
12.2.1.5;A.2.1.5 Recommendation 15;210
12.2.1.6;A.2.1.6 Recommendation 16;210
12.2.1.7;A.2.1.7 Recommendation 17;211
12.2.1.8;A.2.1.8 Recommendation 18;211
12.2.1.9;A.2.1.9 Recommendation 19;211
12.2.1.10;A.2.1.10 Recommendation 20;211
12.2.1.11;A.2.1.11 Recommendation 21;212
12.2.2;A.2.2 Beyond Data Protection;212
12.2.2.1;A.2.2.1 Data Protection and Fundamental Liberties;212
12.2.2.2;A.2.2.2 Recommendation 22;212
12.2.2.3;A.2.2.3 Recommendation 23;213
12.2.2.4;A.2.2.4 Recommendation 24;213
12.2.2.5;A.2.2.5 Specific Provisions about Terminals and Infrastructures;213
12.2.2.6;A.2.2.6 Recommendation 25;213
12.2.2.7;A.2.2.7 Recommendation 26;214
12.2.2.8;A.2.2.8 Recommendation 27;214
12.2.2.9;A.2.2.9 Recommendation 28;214
12.2.2.10;A.2.2.10 Recommendation 29;214
12.2.2.11;A.2.2.11 Recommendation 30;215
12.2.2.12;A.2.2.12 Towards a Regulation of Profiling Activities;215
12.2.2.13;A.2.2.13 Recommendation 31;215
12.2.2.14;A.2.2.14 Recommendation 32;215
12.2.2.15;A.2.2.15 Recommendation 33;216
12.2.2.16;A.2.2.16 Recommendation 34;216
12.2.2.17;A.2.2.17 Recommendation 35;216
12.2.3;A.2.3 Consumer Protection;216
12.2.3.1;A.2.3.1 Recommendation 36;216
12.2.3.2;A.2.3.2 Recommendation 37;217
12.2.3.3;A.2.3.3 Recommendation 38;217
12.2.3.4;A.2.3.4 Recommendation 39;217
13;Glossary;218
14;Index;220