Design and Implementation of Real-Time Multi-Sensor Vision Systems

This book discusses the design of multi-camera systems and their application to fields such as the virtual reality, gaming, film industry, medicine, automotive industry, drones, etc. The authors cover the basics of image formation, algorithms for stitching a panoramic image from multiple cameras, and multiple real-time hardware system architectures, in order to have panoramic videos. Several specific applications of multi-camera systems are presented, such as depth estimation, high dynamic range imaging, and medical imaging.

Covers every important aspect of multi-camera systems, ranging from image stitching algorithms to custom-designed hardware architectures Discusses the entire implementation pipeline, including issues in real-time systems design Describes a proven approach, including examples of state-of-the-art applications

Auteur
Vladan Popovic received his B.Sc. degree in electrical engineering from the University of Belgrade, School of Electrical Engineering, Serbia in 2009, M.Sc. degree in electrical and electronic engineering, and Ph.D. degree from the Swiss Federal Institute of Technology Lausanne (EPFL), Lausanne, Switzerland, in 2011 and 2016, respectively. In 2016 he joined Intel Corporation, Santa Clara, California as a Research Scientist. His research interests include embedded systems design, real-time implementation of image processing algorithms, computational photography and multi-resolution image processing. He was awarded the Bob Owens Best Student Paper Award at the IEEE Workshop on Signal Processing Systems 2012, and the Logitech prize for his Master thesis in 2011, for outstanding creativity, innovation, pragmatism and economic feasibility.

Kerem Seyid received the B.Sc. degree in Electronics Engineering from Sabanci University, Istanbul, Turkey in 2010, M.Sc. and Ph.D. degree in Electrical Engineering from Swiss Federal Institute of Technology in Lausanne (EPFL), Switzerland in 2012 and 2016, respectively. His research interests include real-time implementation of digital video and image processing systems and digital hardware design.

Ömer Cogal received the B.Sc. degree in electronics engineering from Istanbul Technical University, Istanbul, Turkey, M.Sc. degree from Bogazici University, Istanbul, Turkey, and Ph.D. degree from Swiss Federal Institute of Technology Lausanne (EPFL), Lausanne, Switzerland, in 2005, 2009, and 2015, respectively. In 2015, he joined Heptagon Advanced Micro Optics - AMS Group, Zurich, Switzerland as an Image Processing Specialist. His research interests include digital circuit design, embedded system design, and real-time image processing hardware design.

Abdulkadir Akin is a Postdoctoral Researcher at Quantum Engineering Center (QEC) in ETH Zurich since October 2016. His research at QEC focuses on the design and implementation of very high speed and efficient FPGA based systems to achieve real-time quantum information processing. He obtained his Ph.D. degree in Electrical Engineering at EPFL, Switzerland, in May 2015, and he worked as a Postdoctoral Researcher in the same university at Microelectronic Systems Laboratory (LSM). During his PhD studies, he mainly worked on design and implementation of stereoscopic distance measurement and omnidirectional video generation systems. He received his B.Sc. and M.Sc. degrees from Sabanci University, in 2008 and 2010, respectively. During his bachelor and master degrees, he worked on FPGA implementations of video enhancement and compression algorithms.

Yusuf Leblebici received his B.Sc. and M.Sc. degrees in electrical engineering from Istanbul Technical University, in 1984 and in 1986, respectively, and his Ph.D. degreein electrical and computer engineering from the University of Illinois at Urbana-Champaign (UIUC) in 1990. Between 1991 and 2001, he worked as a faculty member at UIUC, at Istanbul Technical University, and at Worcester Polytechnic Institute (WPI). In 2000-2001, he also served as the Microelectronics Program Coordinator at Sabanci University. Since 2002, he is a Chair Professor at the Swiss Federal Institute of Technology in Lausanne (EPFL), and director of Microelectronic Systems Laboratory. His research interests include design of high-speed CMOS digital and mixed-signal integrated circuits, computer-aided design of VLSI systems, intelligent sensor interfaces, modeling and simulation of semiconductor devices, and VLSI reliability analysis. He is the coauthor of six textbooks: Hot-Carrier Reliability of MOS VLSI Circuits (Kluwer Academic Publishers, 1993), CMOS Digital Integrated Circuits: Analysis and Design (McGraw Hill, 1st Edition 1996, 2nd Edition 1998, 3rd Edition 2002, 4th Edition 2014), CMOS Multichannel Single-Chip Receivers for Multi-Gigabit Optical Data Communications (Springer, 2007) and Fundamentals of High Frequency CMOS Analog Integrated Circuits (Cambridge University Press, 2009), Nanosystems Design and Technology (Springer, 2009), and Extreme Low-Power Mixed Signal IC Design: Subthreshold Source-Coupled Circuits (Springer, 2011), as well as more than 300 articles published in various journals and conferences. Dr. Leblebici has served as an Associate Editor of IEEE Transactions on Circuits and Systems (II), and IEEE Transactions on Very Large Scale Integrated (VLSI) Systems. He also served as the general co-chair of the 2006 European Solid-State Circuits Conference, and the 2006 European Solid State Device Research Conference (ESSCIRC/ESSDERC). He is a Fellow of IEEE and has been elected as Distinguished Lecturer of the IEEE Circuits and Systems Society for 2010-2011.

Contenu
Chapter 1.Introduction.- Chapter 2.State-of-the-Art Multi-Camera Systems.- Chapter 3.Panorama Construction Algorithms.- Chapter 4.Omnidirectional Multi-Camera Systems Design.- Chapter 5.Miniaturization of Multi-Camera Systems.- Chapter 6.Interconnected Network of Cameras.- Chapter 7.Towards Real-Time Gigapixel Video.- Chapter 8.Binocular and Trinocular Disparity Estimation.- Chapter 9.Real-Time Image Registration via Optical Flow Calculation.- Chapter 10. Computational Imaging Applications.-Chapter 11. Conclusion.