Wolf Smart Camera Design

Algorithms, Architectures, and Art
1. Auflage 2018
ISBN: 978-3-319-69523-5
Verlag: Springer Nature Switzerland
Format: PDF
Kopierschutz: 1 - PDF Watermark

E-Book, Englisch, 234 Seiten

This book describes the algorithms and computer architectures used to create and analyze photographs in modern digital cameras. It also puts the capabilities of digital cameras into context for applications in art, entertainment, and video analysis.   The author discusses the entire range of topics relevant to digital camera design, including image processing, computer vision, image sensors, system-on-chip, and optics, while clearly describing the interactions between design decisions at these different levels of abstraction.  Readers will benefit from this comprehensive view of digital camera design, describing the range of algorithms used to compose, enhance, and analyze images, as well as the characteristics of optics, image sensors, and computing platforms that determine the physical limits of image capture and computing.  The content is designed to be used by algorithm designers and does not require an extensive background in optics or electronics.

Marilyn Wolf received her bachelor's, master's, and doctoral degrees in electrical engineering from Stanford University in 1980, 1981, and 1984, respectively. She was with AT&T Bell Laboratories in Murray Hill, N.J. from 1984 to 1989 and was with Princeton University from 1989 until 2007. In July 2007, Dr. Wolf joined Georgia Tech as the Rhesa 'Ray' S. Farmer, Jr. Distinguished Chair in Embedded Computing Systems and Georgia Research Alliance Eminent Scholar. She has developed a number of techniques for embedded computing, ranging from hardware/software co-design algorithms and real-time scheduling algorithms to code compression and distributed smart cameras. She is a co-founder of Verificon Corporation, which designs smart camera systems. She helped to start several technical conferences, including CODES and MPSoC. She has written four textbooks.

Autoren/Hrsg.

Wolf, Marilyn

Inhaltsverzeichnis

1;Preface;6
2;Contents;8
3;Chapter 1: Digital Photography;12
3.1;1.1 Introduction;12
3.2;1.2 Previsualization and Autoprevisualization;12
3.3;1.3 Enhanced Images;13
3.4;1.4 Beyond Images to Analysis;14
3.5;1.5 Still and Moving Images;14
3.6;1.6 Taking a Picture;14
3.7;1.7 How to Read this Book;16
4;Chapter 2: Light, Optics, and Imaging;18
4.1;2.1 Introduction;18
4.2;2.2 Image Formation;18
4.2.1;2.2.1 Light and Images;18
4.2.2;2.2.2 The Physics of Light;22
4.3;2.3 The Human Visual System;26
4.4;2.4 Color Science;30
4.4.1;2.4.1 Theories of Color Vision;30
4.4.2;2.4.2 Color Models;31
4.5;2.5 Lenses;33
4.5.1;2.5.1 Lenses and Image Formation;34
4.5.2;2.5.2 Ray Optics;37
4.5.3;2.5.3 Lens Design;39
4.5.4;2.5.4 Panoramas;44
4.5.5;2.5.5 Assessing Lenses;49
4.6;2.6 Geometry and the Camera Model;52
4.6.1;2.6.1 Projective Geometry;52
4.6.2;2.6.2 The Camera Model;55
4.6.3;2.6.3 Camera Calibration;57
4.7;2.7 Image Display;59
4.8;2.8 Practical Image Capture;61
4.8.1;2.8.1 Exposure Settings;62
4.8.2;2.8.2 Which Exposure Setting?;63
4.8.3;2.8.3 Color Temperature;67
4.8.4;2.8.4 Image Composition;69
4.8.5;2.8.5 Image Quality Assessment;74
4.9;2.9 Summary;77
5;Chapter 3: Image Capture Systems and Algorithms;78
5.1;3.1 Introduction;78
5.2;3.2 The Generic Camera Architecture;79
5.3;3.3 The Camera Design Space;80
5.3.1;3.3.1 Trade-Offs;80
5.3.2;3.3.2 Use Cases for Cameras;81
5.3.3;3.3.3 Four Examples of Camera Designs;81
5.4;3.4 Image Sensors;84
5.4.1;3.4.1 Image Sensor Architectures;84
5.4.2;3.4.2 Photosensors;86
5.4.3;3.4.3 Charge-Coupled Devices;88
5.4.4;3.4.4 APS CMOS Image Sensors;89
5.4.5;3.4.5 Advanced Image Sensors;93
5.4.6;3.4.6 Image Sensor Characteristics;94
5.4.7;3.4.7 Shutters and Irises;100
5.5;3.5 Preexposure Operations;102
5.5.1;3.5.1 Autofocus;103
5.5.2;3.5.2 Exposure;107
5.5.3;3.5.3 Image Stabilization;109
5.5.4;3.5.4 Face Detection and Tracking;110
5.6;3.6 Postexposure Operations;113
5.6.1;3.6.1 Color Filter Array Interpolation;113
5.6.2;3.6.2 White Balance;116
5.6.3;3.6.3 Sharpening;118
5.7;3.7 Image and Video Compression;119
5.7.1;3.7.1 Lossy Compression;119
5.7.2;3.7.2 Image Coding and JPEG;119
5.7.3;3.7.3 Video Coding, H.264/AVC, and HEVC/H.265;124
5.7.4;3.7.4 Quality Assessment of Compressed Images;131
5.8;3.8 Computing Platforms;132
5.8.1;3.8.1 Cameras as Heterogeneous Multiprocessors;132
5.8.2;3.8.2 Buffering;133
5.8.3;3.8.3 Input and Output;135
5.8.4;3.8.4 File Formats;135
5.8.5;3.8.5 Operating Systems and File Systems;137
5.8.6;3.8.6 Accelerators;137
5.9;3.9 Image Characteristics and Image Capture;141
5.10;3.10 Stereo and Multicamera Systems;142
5.11;3.11 Trade-Offs Revisited;143
6;Chapter 4: Image and Video Enhancement;145
6.1;4.1 Introduction;145
6.2;4.2 Useful Algorithms;146
6.3;4.3 Tonal Mapping and Color Grading;148
6.4;4.4 High-Dynamic Range Images;153
6.5;4.5 Sharpening and Superresolution;156
6.6;4.6 Bokeh Introduction;159
6.7;4.7 Lens Corrections;159
6.8;4.8 Focus Stacking;160
6.9;4.9 Keystone Correction;162
6.10;4.10 Mosaic Composition;163
6.11;4.11 Video Stabilization;166
6.11.1;4.11.1 Optical Flow;166
6.11.2;4.11.2 Stabilization Algorithms;167
6.12;4.12 Software Design for Image Enhancement;168
6.13;4.13 Practical Image Enhancement;170
7;Chapter 5: Image and Video Analysis;172
7.1;5.1 Introduction;172
7.2;5.2 Image Analysis Algorithms;173
7.3;5.3 Image and Video Characteristics;176
7.3.1;5.3.1 Image Statistics;176
7.3.2;5.3.2 Saliency;177
7.3.3;5.3.3 Key Frame Selection;179
7.4;5.4 Scene Analysis;180
7.4.1;5.4.1 Visual Search;180
7.4.2;5.4.2 Face Detection and Recognition;181
7.5;5.5 Tracking;182
7.5.1;5.5.1 Background Elimination;182
7.5.2;5.5.2 Tracking from a Fixed Camera;184
7.5.3;5.5.3 Appearance Models;187
7.5.4;5.5.4 Activity Analysis;190
7.5.5;5.5.5 Tracking from a Moving Camera;192
7.6;5.6 Multicamera Systems;195
7.6.1;5.6.1 Multicamera Systems as Distributed Computing Systems;196
7.6.2;5.6.2 Multicamera Calibration;198
7.6.3;5.6.3 Multicamera Tracking;200
7.7;5.7 Use Cases and Workflows;206
8;Chapter 6: Photography and Cinematography;207
8.1;6.1 Introduction;207
8.2;6.2 Photography;207
8.3;6.3 Cinematography;213
9;References;221