E-Book, Englisch, 550 Seiten
Mrak / Grgic / Kunt High-Quality Visual Experience
1. Auflage 2010
ISBN: 978-3-642-12802-8
Verlag: Springer
Format: PDF
Kopierschutz: 1 - PDF Watermark
Creation, Processing and Interactivity of High-Resolution and High-Dimensional Video Signals
E-Book, Englisch, 550 Seiten
Reihe: Signals and Communication Technology
ISBN: 978-3-642-12802-8
Verlag: Springer
Format: PDF
Kopierschutz: 1 - PDF Watermark
Last few years have seen rapid acceptance of high-definition television (HDTV) technology around the world. This technology has been hugely successful in delivering more realistic television experience at home and accurate imaging for professional applications. Adoption of high definition continues to grow as consumers demand enhanced features and greater quality of content. Following this trend, natural evolution of visualisation technologies will be in the direction of fully realistic visual experience and highly precise imaging. However, using the content of even higher resolution and quality is not straightforward as such videos require significantly higher access bandwidth and more processing power. Therefore, methods for radical reduction of video bandwidth are crucial for realisation of high visual quality. Moreover, it is desirable to look into other ways of accessing visual content, solution to which lies in innovative schemes for content delivery and consumption. This book presents selected chapters covering technologies that will enable greater flexibility in video content representation and allow users to access content from any device and to interact with it.
Autoren/Hrsg.
Weitere Infos & Material
1;Title Page;1
2;Preface;4
3;Contents;6
4;Part I Quality of Visual Information;10
4.1;Automatic Prediction of Perceptual Video Quality: Recent Trends and Research Directions;11
4.1.1;Introduction;12
4.1.2;Performance Evaluation of Algorithms and Databases;13
4.1.3;A Brief Foray into the Human Visual System;15
4.1.4;Reduced-Reference Algorithms;17
4.1.4.1;Techniques Based on Watermarking;17
4.1.4.2;Other Techniques;18
4.1.5;No-Reference Algorithms;21
4.1.5.1;Blockiness-Based Techniques;21
4.1.5.2;Multiple Artifact Measurement Based Techniques;22
4.1.5.3;Other Techniques;24
4.1.6;Conclusion;26
4.1.7;References;27
4.2;Quality of Experience for High Definition Presentations – Case: Digital Cinema;32
4.2.1;Introduction;32
4.2.2;Role of Human Visual System in the Perception of Visual Quality;35
4.2.2.1;Cortical Processing of Stimuli;36
4.2.2.2;Perception and Attention;36
4.2.3;Subjective Image Quality Assessment in D-Cinema;38
4.2.3.1;Laboratory Set Up;38
4.2.3.2;Test Materials;41
4.2.3.3;Test Methods and Conditions;41
4.2.3.4;Subjects;43
4.2.3.5;Subjective Data Analysis;43
4.2.4;Objective Image Metrics in D-Cinema;44
4.2.4.1;Visual Characteristics in D-Cinema and Its Application to Image Quality Metrics;45
4.2.4.2;Performance Evaluation of Image Quality Metrics in D-Cinema;49
4.2.5;Quality as Part of the Business Plan;51
4.2.5.1;Case: D-Cinema;51
4.2.5.2;Does Quality Matter?;53
4.2.6;Discussions and Conclusions;54
4.2.7;References;56
4.3;Quality of Visual Experience for 3D Presentation – Stereoscopic Image;58
4.3.1;Introduction;59
4.3.2;Subjective Stereoscopic Image Quality Assessment;63
4.3.2.1;Experimental Materials and Methodology;63
4.3.2.2;Experimental Results and Analysis;65
4.3.3;Perceptual Stereoscopic Image Quality Metric Based on 2D Image Quality Metrics and Disparity Analysis;69
4.3.3.1;Introduction to 2D Image Quality Metrics;70
4.3.3.2;Performance Analysis of IQMs on 2D and Stereoscopic Image Quality Assessment;72
4.3.3.3;Perceptual Stereoscopic Quality Assessment Based on Disparity Information;75
4.3.4;Conclusions;81
4.3.5;References;82
5;Part II Video Coding for High Resolutions;85
5.1;The Development and Standardization of Ultra High Definition Video Technology;86
5.1.1;Introduction;86
5.1.2;Progress of Digital Video Technique;87
5.1.2.1;History of Video Coding;87
5.1.2.2;Technical Standardization for Video Coding;91
5.1.3;Video Coding Technology;94
5.1.3.1;The Shannon Theory and Video Coding Technology;94
5.1.3.2;Main Components of Video Coding;95
5.1.3.3;MPEG Coding Methods;106
5.1.4;Requirement for Quality of UHD Video System;118
5.1.4.1;Required Specifications for UHD Video Service;118
5.1.4.2;Expectation for New Video Coding Technology;123
5.1.5;Progress of Device Technologies Supporting UHD Video;123
5.1.5.1;Video Capture Device;123
5.1.5.2;Display;124
5.1.5.3;Storage;127
5.1.5.4;Digital Network for Communication and Broadcasting;127
5.1.6;Standardization of UHD Video Coding Technology;130
5.1.6.1;Realization of UHD Video Application;130
5.1.6.2;Next Generation Video Coding Standard;130
5.1.6.3;Challenge toward UHD Video Coding;131
5.1.7;Realization of UHD Service and System;137
5.1.7.1;Realization of UHD Service;137
5.1.7.2;Another Possibility of Video Coding Technology in Future;137
5.1.8;Summary;139
5.1.9;References;139
5.2;Compression Formats for HD Recording and Production;141
5.2.1;Introduction;141
5.2.2;720p vs. 1080i;143
5.2.3;H.264/AVC;145
5.2.4;Motion JPEG 2000;148
5.2.5;Experiments;151
5.2.6;Conclusions;158
5.2.7;References;159
5.3;Super Hi-Vision and Its Encoding System;161
5.3.1;Introduction;161
5.3.2;Super Hi-Vision Systems;162
5.3.2.1;Video System of SHV;162
5.3.2.2;Audio System of SHV;163
5.3.2.3;Roadmap of SHV;165
5.3.3;Codec Systems;165
5.3.3.1;Video Format Converter;166
5.3.3.2;MPEG-2-Based Codec;167
5.3.3.3;AVC/H.264-Based Codec;169
5.3.4;Demonstrations and Experiments;171
5.3.4.1;IP Transmission;171
5.3.4.2;Satellite Transmission;174
5.3.5;Conclusion;177
5.3.6;References;178
5.4;A Flexible Super High Resolution Video CODEC and Its Trial Experiments;180
5.4.1;Introduction;180
5.4.2;Basic Concept;181
5.4.2.1;Basic Concept of SHR CODEC;181
5.4.2.2;Spatially Parallel SHR CODEC System;181
5.4.3;Video Shift and Padding Function;183
5.4.4;Switchable Cascade Multiplexing Function;185
5.4.5;Two Synchronization Schemes;188
5.4.6;Rate Control in Multiplexing Mode;189
5.4.7;Evaluation;192
5.4.8;Experimental System;194
5.4.9;Trial;195
5.4.10;Conclusion;197
5.4.11;References;198
5.5;Mathematical Modeling for High Frame-Rate Video Signal;199
5.5.1;Introduction;199
5.5.2;Relationship between Frame-Rate and Inter-frame Prediction Error;202
5.5.2.1;Mathematical Model for Temporal Sub-sampling by Frame Skip;202
5.5.2.2;Mathematical Model of Temporal Down-Sampling by Mean Filter;206
5.5.3;Evaluation of Proposed Models;210
5.5.3.1;Captured High Frame-Rate Video Signal;210
5.5.3.2;Regression Analyses of the Proposed Models;210
5.5.4;Conclusion;216
5.5.5;References;216
6;Part III Visual Content Upscaling;218
6.1;Next Generation Frame Rate Conversion Algorithms;219
6.1.1;Introduction;220
6.1.2;Related Work;220
6.1.3;Region-Based FRUC by Homography Model Parameter Interpolation (FRUC-RH);222
6.1.3.1;Motion Layer Correspondence Establishment;223
6.1.3.2;Motion Model Parameter Interpolation;224
6.1.3.3;Layer Map Interpolation;227
6.1.3.4;Middle Frame Interpolation;228
6.1.3.5;Results;229
6.1.4;Region-Based Multi-view FRUC by Rigid Body Motion Model Parameter Interpolation (FRUC-RM);231
6.1.4.1;Depth-Based Moving Object Segmentation;232
6.1.4.2;3D Motion Estimation;235
6.1.4.3;Middle Frame Interpolation;236
6.1.5;Summary;242
6.1.6;References;242
6.2;Spatiotemporal Video Upscaling Using Motion-Assisted Steering Kernel (MASK) Regression;245
6.2.1;Introduction;245
6.2.2;Review of Steering Kernel Regression;248
6.2.2.1;Kernel Regression in 2-D;248
6.2.2.2;Steering Kernel Function;251
6.2.3;Motion Assisted Steering Kernel Regression;254
6.2.3.1;Spatiotemporal Kernel Regression;254
6.2.3.2;Motion Assisted Steering Kernel Function;255
6.2.3.3;Spatial Upscaling and Temporal Frame Interpolation;256
6.2.4;A Practical Video Upscaling Algorithm Based on MASK;258
6.2.4.1;Block-by-Block Processing;260
6.2.4.2;Motion Estimation and Adaptive Temporal Penalization;261
6.2.4.3;Quantization of Orientation Map;262
6.2.4.4;Adaptive Regression Order;265
6.2.5;Example Video Upscaling and Denoising Results;267
6.2.6;Conclusion;273
6.2.7;References;273
6.3;Temporal Super Resolution Using Variational Methods;275
6.3.1;Background;275
6.3.1.1;Frame Rate Requirements;277
6.3.1.2;Blur Acceptance in Human Vision;277
6.3.1.3;Related Work;278
6.3.1.4;Motion Compensated Frame Rate Conversion with Simultaneous Flow and Intensity Calculations;279
6.3.1.5;Benchmarking in Testing;280
6.3.1.6;Outline;280
6.3.2;Energy Minimization Formulation;280
6.3.2.1;Variational Temporal Super Resolution;280
6.3.2.2;Implementation of TSR: Frame Doubling;283
6.3.3;Experiments;285
6.3.3.1;Parameters;285
6.3.3.2;Evaluation Methodology;286
6.3.3.3;Frame Doubling Results;287
6.3.3.4;Discussion: Improving Variational Optic Flow for Motion Compensated Methods;294
6.3.4;Conclusion;294
6.3.5;References;295
6.4;Synthesizing Natural Images Using Spatial Layout Information;297
6.4.1;Introduction;297
6.4.2;Image Quilting;298
6.4.2.1;Discussion;300
6.4.3;Texture Synthesis for Natural Images;303
6.4.4;Texture Synthesis Based on Segmentation;305
6.4.5;Conclusion;308
6.4.6;References;308
7;Part IV 3D Visual Content Processing and Displaying;309
7.1;The Use of Color Information in Stereo Vision Processing;310
7.1.1;Introduction;310
7.1.2;Stereo Vision Basics;312
7.1.2.1;The Pinhole Camera Model;312
7.1.2.2;The Stereo Camera Setup;313
7.1.2.3;The Stereo Correspondence Problem;315
7.1.3;Stereo Vision Basics;312
7.1.3.1;The Pinhole Camera Model;312
7.1.3.2;The Stereo Camera Setup;313
7.1.3.3;The Stereo Correspondence Problem;315
7.1.4;The Use of Color Information in Stereo Vision;319
7.1.4.1;Color Spaces;319
7.1.4.2;A Survey of Color Based Stereo Methods;322
7.1.5;Comparisons and Discussion;325
7.1.6;Conclusion;327
7.1.7;References;327
7.2;3D Object Classification and Segmentation Methods;330
7.2.1;Introduction;330
7.2.2;Shape Estimation;331
7.2.2.1;3D Edge Detection;331
7.2.2.2;3D Corner Detection;334
7.2.2.3;Surface Extraction;335
7.2.3;3 D Image Segmentation and Classification;336
7.2.3.1;Thresholding;337
7.2.3.2;Context Modelling and Classification of 3D Objects;339
7.2.3.3;Neural Network Based Segmentation;340
7.2.4;Results;341
7.2.5;Conclusion;345
7.2.6;References;346
7.3;Three-Dimensional Video Contents Exploitation in Depth Camera-Based Hybrid Camera System;347
7.3.1;Introduction;347
7.3.2;Video-Plus-Depth Generation;349
7.3.2.1;Hybrid Camera System;349
7.3.2.2;Depth Calibration;351
7.3.2.3;Depth Image Generation;353
7.3.3;Hierarchical Decomposition of Depth Images;355
7.3.4;MPEG-4-Based 3D Video Contents Exploitation;358
7.3.5;Experimental Analysis;360
7.3.5.1;Evaluation of Depth Accuracy;360
7.3.5.2;3D Video Contents Generation;363
7.3.6;Conclusions;365
7.3.7;References;366
7.4;Improving 3D Visual Experience by Controlling the Perceived Depth Distortion;368
7.4.1;Introduction;369
7.4.2;Previous Related Knowledge;371
7.4.2.1;Viewing;371
7.4.2.2;Shooting;372
7.4.3;Distortion Analysis and Model;375
7.4.4;Shooting Design Scheme for Chosen Distortion;377
7.4.4.1;Controlled Depth Distortion;378
7.4.4.2;Perfect Depth Effect;379
7.4.5;Derived Shooting Technologies;380
7.4.5.1;3D Computer Graphics Software;380
7.4.5.2;3D Devices;382
7.4.5.3;Combination of Real and Virtual 3D Scenes;383
7.4.6;Conclusion;385
7.4.7;References;385
7.5;3D Visual Experience;388
7.5.1;Introduction;388
7.5.2;Stereoscopic Displays;388
7.5.2.1;Time Sequential Separation;389
7.5.2.2;Wavelength Based Separation;389
7.5.2.3;Polarization Based Separation;391
7.5.2.4;Discussion of Stereoscopic Systems;393
7.5.2.5;Stereoscopic 3D Uncompressed Image Formats;393
7.5.2.6;Multi-user Stereo and CAVE Systems;395
7.5.2.7;Head Mounted Displays;396
7.5.3;Autostereoscopic Displays;396
7.5.3.1;Parallax Barrier;397
7.5.3.2;Lenticular Lens;398
7.5.3.3;Wavelength Selective Filters;399
7.5.3.4;Multiview 3D Uncompressed Image Formats;399
7.5.4;Volumetric Displays;400
7.5.5;Light Field Displays;402
7.5.5.1;Integral Imaging;402
7.5.5.2;Holographic Displays;402
7.5.5.3;HoloVizio Type Light-Field Displays;403
7.5.6;Conclusion;404
7.5.7;References;404
7.6;3D Holoscopic Imaging Technology for Real- Time Volume Processing and Display;408
7.6.1;Background;408
7.6.2;3D Holoscopic Content Generation;409
7.6.3;Computer Generation of 3D Holoscopic Images;413
7.6.4;3D Object Segmentation;415
7.6.5;3D Holoscopic Image Compression;417
7.6.5.1;Preprocessing of 3D Holoscopic Images;418
7.6.5.2;2D WDT Based Compression Algorithm;419
7.6.5.3;Proposed Compression Algorithm;420
7.6.5.4;Simulation Results and Discussions;422
7.6.6;Conclusions;423
7.6.7;References;423
8;Part V Accessing Technologies for Visual Content;426
8.1;Video Streaming with Interactive Pan/Tilt/Zoom;427
8.1.1;Introduction;427
8.1.2;Related Work;431
8.1.2.1;Coding for Random Access;431
8.1.2.2;Navigation Path Prediction;433
8.1.2.3;Multicasting;434
8.1.3;Spatial-Random-Access-Enabled Video Coding;435
8.1.4;Pre-fetching Based on RoI Prediction;439
8.1.5;P2P Multicasting for Interactive Region-of-Interest;441
8.1.5.1;System Architecture;441
8.1.5.2;P2P Protocol;442
8.1.5.3;Protocol Performance;444
8.1.5.4;Server Bandwidth Allocation;445
8.1.6;Conclusions;445
8.1.7;References;447
8.2;End-to-End Management of Heterogeneous Environments Enabling Quality of Experience;452
8.2.1;Introduction;453
8.2.2;Architecture and Overall Concept;454
8.2.2.1;End-to-End Management Enabling QoS/QoE;454
8.2.2.2;Cross-Layer QoS/QoE Adaptation Concept;455
8.2.3;ENTHRONE Integrated Management Supervisor (EIMS);456
8.2.3.1;Architecture Overview;456
8.2.3.2;End-to-End QoS Manager;457
8.2.3.3;Service Manager;458
8.2.3.4;Adaptation Manager;458
8.2.3.5;Metadata Manager;459
8.2.3.6;Search Manager;459
8.2.3.7;Multicast Manager;459
8.2.3.8;Caching and CDN Manager;460
8.2.3.9;Summary;460
8.2.4;Measuring Quality of Experience for MPEG-21-Based Cross-Layer Multimedia Content Adaptation;461
8.2.4.1;Introduction;461
8.2.4.2;Probing Quality of Service;461
8.2.4.3;An Interoperable QoS Model for Video Transmission Exploiting Cross-Layer Interactions;462
8.2.5;Conclusions;469
8.2.6;References;469
8.3;Quality-Driven Coding and Prioritization of 3D Video over Wireless Networks;472
8.3.1;Introduction;472
8.3.2;3D Video Transmission;474
8.3.2.1;3D Video Fundamentals;474
8.3.2.2;Perceptually Optimized Coding;476
8.3.2.3;Quality of Service for Wireless Local Area Networks;476
8.3.2.4;Robust Transmission;477
8.3.3;Cross-Layer Design for Optimized 3D Video Transmission;478
8.3.3.1;Design of Cross Layer Video Communications System;478
8.3.3.2;3D Video Object Segmentation for Packet Prioritization;480
8.3.3.3;Quality-Driven Coding;480
8.3.3.4;Optimized Transmission and Decoding;481
8.3.4;Experimental Results;483
8.3.4.1;Experimental Setup;483
8.3.4.2;Performance Evaluation;485
8.3.4.3;Subjective Quality Results;488
8.3.5;Conclusions;488
8.3.6;References;489
8.4;Scalable Indexing of HD Video;491
8.4.1;Introduction;491
8.4.2;HD Content Indexing in the Compressed Domain;492
8.4.2.1;Scalable Compression Standards;492
8.4.2.2;Scalable Extraction of Low and Mid-level Features from Compressed Streams;496
8.4.2.3;On Scalable Content-Based Queries;504
8.4.3;HD Content Indexing Using Patch Descriptors in the Wavelet Domain;508
8.4.3.1;Sparse Multiscale Patches and Motion Patches Descriptors;508
8.4.3.2;Using the Kullback-Leibler Divergence as a Similarity Measure;510
8.4.3.3;Scalable Content-Based Queries with Patches Descriptors;512
8.4.4;Conclusion and Perspectives;516
8.4.5;References;516
8.5;Stereo Correspondence in Information Retrieval;519
8.5.1;Introduction;519
8.5.2;Maximum Likelihood Estimation for Flat Surface Detection;521
8.5.2.1;Estimation of a Depth Map;521
8.5.2.2;Iterative RANSAC Planar Surface Detection;522
8.5.2.3;Case Study;525
8.5.3;Segment Based Stereo Matching;527
8.5.3.1;Colour Segmentation;528
8.5.3.2;Estimation of Disparity Planes;529
8.5.4;Connectivity Based Stereo Correspondence;531
8.5.5;Wide Baseline Stereo Correspondence Using Local Descriptors;533
8.5.6;Evaluation of Different Methods;535
8.5.7;Conclusions and Future Work;539
8.5.8;References;539
9;Author Index;542
