3D Video

While 3D vision has existed for many years, the use of 3D cameras and video-based modeling by the film industry has induced an explosion of interest for 3D acquisition technology, 3D content and 3D displays. As such, 3D video has become one of the new technology trends of this century. The chapters in this book cover a large spectrum of areas connected to 3D video, which are presented both theoretically and technologically, while taking into account both physiological and perceptual aspects. Stepping away from traditional 3D vision, the authors, all currently involved in these areas, provide the necessary elements for understanding the underlying computer-based science of these technologies. They consider applications and perspectives previously unexplored due to technological limitations. This book guides the reader through the production process of 3D videos; from acquisition, through data treatment and representation, to 3D diffusion. Several types of camera systems are considered (multiscopic or multiview) which lead to different acquisition, modeling and storage-rendering solutions. The application of these systems is also discussed to illustrate varying performance benefits, making this book suitable for students, academics, and also those involved in the film industry.

Auteur

Laurent Lucas currently leads the SIC research group and is
in charge of the virtual reality platform of the URCA (University
of Reims Champagne Ardenne) in France. His research interests
include visualization and co-operation between image processing and
computer graphics, particularly in 3DTV, and their applications.

Céline Loscos is Professor at the URCA, within the
CReSTIC laboratory, and teaches computer science at the University
Institute of Technology (IUT) in Champagne Ardenne, France.

Yannick Remion's research interests include dynamic
animation, simulation and co-operation between image processing and
computer graphics as well as 3D vision.

Contenu

Foreword xv

Notations xix

Acknowledgments xxiii

Introduction xxv
Laurent LUCAS, Celine LOSCOS and Yannick REMION

PART 1. 3D ACQUISITION OF SCENES 1

Chapter 1. Foundation 3
Laurent LUCAS, Yannick REMION and Celine LOSCOS

1.1. Introduction 3

1.2. A short history 5

1.3. Stereopsis and 3D physiological aspects 14

1.4. 3D computer vision 17

1.5. Conclusion 20

1.6. Bibliography 20

Chapter 2. Digital Cameras: Definitions and Principles 23
Min H. KIM, Nicolas HAUTIERE and Celine LOSCOS

2.1. Introduction 23

2.2. Capturing light: physical fundamentals 24

2.3. Digital camera 28

2.4. Cameras, human vision and color 33

2.5. Improving current performance 35

2.6. Conclusion 38

2.7. Bibliography 38

Chapter 3. Multiview Acquisition Systems 43
Frederic DEVERNAY, Yves PUPULIN and Yannick REMION

3.1. Introduction: what is a multiview acquisition system? 43

3.2. Binocular systems 45

3.3. Lateral or directional multiview systems 54

3.4. Global or omnidirectional multiview systems 61

3.5. Conclusion 66

3.6. Bibliography 66

Chapter 4. Shooting and Viewing Geometries in 3DTV 71
Jessica PREVOTEAU, Laurent LUCAS and Yannick REMION

4.1. Introduction 71

4.2. The geometry of 3D viewing 72

4.3. The geometry of 3D shooting 75

4.4. Geometric impact of the 3D workflow 80

4.5. Specification methodology for multiscopic shooting 84

4.6. OpenGL implementation 86

4.7. Conclusion 87

4.8. Bibliography 88

Chapter 5. Camera Calibration: Geometric and Colorimetric Correction 91
Vincent NOZICK and Jean-Baptiste THOMAS

5.1. Introduction 91

5.2. Camera calibration 91

5.3. Radial distortion 95

5.4. Image rectification 98

5.5. Colorimetric considerations in cameras 103

5.6. Conclusion 109

5.7. Bibliography 110

PART 2. DESCRIPTION/RECONSTRUCTION OF 3D SCENES 113

Chapter 6. Feature Points Detection and Image Matching 115
Michel DESVIGNES, Lara YOUNES and Barbara ROMANIUK

6.1. Introduction 115

6.2. Feature points 116

6.3. Feature point descriptors 123

6.4. Image matching 128

6.5. Conclusion 131

6.6. Bibliography 132

Chapter 7. Multi- and Stereoscopic Matching, Depth and Disparity 137
Stephanie PREVOST, Cedric NIQUIN, Sylvie CHAMBON and Guillaume GALES

7.1. Introduction 137

7.2. Difficulties, primitives and stereoscopic matching 138

7.3. Simplified geometry and disparity 139

7.4. A description of stereoscopic and multiscopic methods 141

7.5. Methods for explicitly accounting for occlusions 147

7.6. Conclusion 153

7.7. Bibliography 154

Chapter 8. 3D Scene Reconstruction and Structuring 157
Ludovic BLACHE, Muhannad ISMAEL and Philippe SOUCHET

8.1. Problems and challenges 157

8.2. Silhouette-based reconstruction 158

8.3. Industrial application 162

8.4. Temporally structuring reconstructions 166

8.5. Conclusion 170

8.6. Bibliography 171

Chapter 9. Synthesizing Intermediary Viewpoints 173
Luce MORIN, Olivier LE MEUR, Christine GUILLEMOT, Vincent JANTET and Josselin GAUTIER

9.1. Introduction 173

9.2. Viewpoint synthesis by interpolation and extrapolation 173

9.3. Inpainting uncovered zones 181

9.4. Conclusion 189 9.5. Bibliograp...