journal article·2019-09-30Open access

An Overview of Lidar Imaging Systems for Autonomous Vehicles

Santiago Royo, Maria Ballesta-Garcia

Applied Sciences· Volume 9· Issue 19

Abstract

Lidar imaging systems are one of the hottest topics in the optronics industry. The need to sense the surroundings of every autonomous vehicle has pushed forward a race dedicated to deciding the final solution to be implemented. However, the diversity of state-of-the-art approaches to the solution brings a large uncertainty on the decision of the dominant final solution. Furthermore, the performance data of each approach often arise from different manufacturers and developers, which usually have some interest in the dispute. Within this paper, we intend to overcome the situation by providing an introductory, neutral overview of the technology linked to lidar imaging systems for autonomous vehicles, and its current state of development. We start with the main single-point measurement principles utilized, which then are combined with different imaging strategies, also described in the paper. An overview of the features of the light sources and photodetectors specific to lidar imaging systems most frequently used in practice is also presented. Finally, a brief section on pending issues for lidar development in autonomous vehicles has been included, in order to present some of the problems which still need to be solved before implementation may be considered as final. The reader is provided with a detailed bibliography containing both relevant books and state-of-the-art papers for further progress in the subject.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Optical Sensing Technologies · Ocular and Laser Science Research · Spectroscopy and Laser Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Centre for Sensor, Instrumentation and Systems Development, Universitat Politècnica de Catalunya (CD6-UPC), Rambla Sant Nebridi 10, E08222 Terrassa, Spain

Beamagine S.L., C/Bellesguard 16, E08755 Castellbisbal, Spain

References (100+)

Show source-provided references
1. Woodside Capital Partners & Yole Développement (2018). Automotive LiDAR Market Report, Optical Society of America. OIDA Publications & Reports.
2. Schoonover, D. (2019). The Driverless Car Is Closer Than You Think—And I Can’t Wait, Forbes.
3. Comerón, A., Muñoz-Porcar, C., Rocadenbosch, F., Rodríguez-Gómez, A., and Sicard, M. (2017). Current research in LIDAR technology used for the remote sensing of atmospheric aerosols. Sensors, 17.10.3390/s17061450 ↗
4. McManamon, P.F. (2015). Field Guide to Lidar, SPIE.10.1117/3.2186106 ↗
5. Weitkamp, C. (2005). LiDAR: Introduction. Laser Remote Sensing, CRC Press.10.1201/9781420030754.ch1 ↗
6. Dong, P., and Chen, Q. (2018). LiDAR Remote Sensing and Applications, CRC Press.10.4324/9781351233354 ↗
7. (2019, September 27). Remote Sensing—Open Access Journal. Available online: https://www.mdpi.com/journal/remotesensing.
8. (2019, September 27). Remote Sensing—Events. Available online: https://www.mdpi.com/journal/remotesensing/events.
9. Douillard, B., Underwood, J., Kuntz, N., Vlaskine, V., Quadros, A., Morton, P., and Frenkel, A. (2011, January 9–13). On the segmentation of 3D LIDAR point clouds. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.10.1109/ICRA.2011.5979818 ↗
10. Premebida, C., Carreira, J., Batista, J., and Nunes, U. (2014, January 14–18). Pedestrian detection combining rgb and dense lidar data. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Chicago, IL, USA.10.1109/IROS.2014.6943141 ↗
11. Neumann, U., You, S., Hu, J., Jiang, B., and Lee, J. (2003, January 22–26). Augmented virtual environments (ave): Dynamic fusion of imagery and 3d models. Proceedings of the IEEE Virtual Reality, Los Angeles, CA, USA.
12. Himmelsbach, M., Mueller, A., Lüttel, T., and Wünsche, H.J. (2008). LIDAR-Based 3D Object Perception, IRIT.
13. Time-of-flight cameras in computer graphics10.1111/j.1467-8659.2009.01583.x ↗
14. Enhanced computer vision with microsoft kinect sensor: A review10.1109/TCYB.2013.2265378 ↗
15. Darlington, K. (2018). The Social Implications of Driverless Cars, BBVA OpenMind.
16. Moosmann, F., and Stiller, C. (2011, January 5–9). Velodyne slam. Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Baden-Baden, Germany.10.1109/IVS.2011.5940396 ↗
17. Lidar system architectures and circuits10.1109/MCOM.2017.1700030 ↗
18. Distance measurement error in time-of-flight sensors due to shot noise10.3390/s150304624 ↗
19. Sarbolandi, H., Plack, M., and Kolb, A. (2018). Pulse Based Time-of-Flight Range Sensing. Sensors, 18.10.3390/s18061679 ↗
20. Theiß, S. (2015). Analysis of a Pulse-Based ToF Camera for Automotive Application. [Master’s Thesis, University of Siegen].
21. O’Connor, D. (2012). Time-Correlated Single Photon Counting, Academic Press.
22. Koskinen, M., Kostamovaara, J.T., and Myllylae, R.A. (1992, January 1). Comparison of continuous-wave and pulsed time-of-flight laser range-finding techniques. Proceedings of the Optics, Illumination, and Image Sensing for Machine Vision VI, Anaheim, CA, USA.10.1117/12.57989 ↗
23. Airborne laser scanning—An introduction and overview10.1016/S0924-2716(99)00011-8 ↗
24. An overview of depth cameras and range scanners based on time-of-flight technologies10.1007/s00138-016-0784-4 ↗
25. Richmond, R., and Cain, S. (2010). Direct-Detection LADAR Systems, SPIE Press.10.1117/3.836466 ↗
26. Laser ranging: A critical review of unusual techniques for distance measurement10.1117/1.1330700 ↗
27. Hansard, M., Lee, S., Choi, O., and Horaud, R.P. (2012). Time-of-Flight Cameras: Principles, Methods and Applications, Springer Science & Business Media.10.1007/978-1-4471-4658-2 ↗
28. Gokturk, S.B., Yalcin, H., and Bamji, C. (July, January 27). A time-of-flight depth sensor-system description, issues and solutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop, Washington, DC, USA.
29. Robust 3D measurement with PMD sensors
30. Lefloch, D., Nair, R., Lenzen, F., Schäfer, H., Streeter, L., Cree, M.J., Koch, R., and Kolb, A. (2013). Technical foundation and calibration methods for time-of-flight cameras. Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications, Springer.10.1007/978-3-642-44964-2_1 ↗
31. Solid-state time-of-flight range camera10.1109/3.910448 ↗
32. Lock-in time-of-flight (ToF) cameras: A survey10.1109/JSEN.2010.2101060 ↗
33. Oggier, T., Büttgen, B., Lustenberger, F., Becker, G., Rüegg, B., and Hodac, A. (, 2005). SwissRanger SR3000 and first experiences based on miniaturized 3D-TOF cameras. Proceedings of the First Range Imaging Research Day at ETH Zurich, Zurich.
34. Petermann, K. (1988). Advances in Optoelectronics, Springer.
35. Frequency-modulated optical feedback interferometry for nanometric scale vibrometry10.1109/LPT.2016.2531790 ↗
36. Range-resolved pulsed and CWFM lidars: Potential capabilities comparison10.1007/s00340-006-2254-6 ↗
37. Precision time domain reflectometry in optical fiber systems using a frequency modulated continuous wave ranging technique10.1109/JLT.1985.1074315 ↗
38. Aulia, S., Suksmono, A.B., and Munir, A. (2015, January 9–12). Stationary and moving targets detection on FMCW radar using GNU radio-based software defined radio. Proceedings of the IEEE International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), Nusa Dua, Indonesia.10.1109/ISPACS.2015.7432817 ↗
39. Wojtkiewicz, A., Misiurewicz, J., Nalecz, M., Jedrzejewski, K., and Kulpa, K. (1997). Two-dimensional signal processing in FMCW radars. Proceeding of the XXth National Conference on Circuit Theory and Electronic Networks, University of Mining and Metallurgy.
40. Frequency-modulated multifunction lidar for anemometry, range finding, and velocimetry—1. Theory and signal processing10.1364/AO.56.009663 ↗
41. Automotive radar and lidar systems for next generation driver assistance functions10.5194/ars-3-205-2005 ↗
42. Optimization of eyesafe avalanche photodiode lidar for automobile safety and autonomous navigation systems10.1117/1.OE.56.3.031224 ↗
43. The electronically steerable flash lidar: A full waveform scanning system for topographic and ecosystem structure applications10.1109/TGRS.2012.2193588 ↗
44. Scanning LIDAR in Advanced Driver Assistance Systems and Beyond: Building a road map for next-generation LIDAR technology10.1109/MCE.2016.2556878 ↗
45. National Research Council (2014). Laser Radar: Progress and Opportunities in Active Electro-Optical Sensing, National Academies Press.
46. Montagu, J. (2016). Galvanometric and Resonant Scanners. Handbook of Optical and Laser Scanning, CRC Press. [2nd ed.].10.1201/9780203749142-5 ↗
47. Motion control of the wedge prisms in Risley-prism-based beam steering system for precise target tracking10.1364/AO.52.002849 ↗
48. Liquid crystal waveguides: New devices enabled by > 1000 waves of optical phase control10.1117/12.851788 ↗
49. Transmissive beam steering through electrowetting microprism arrays10.1016/j.optcom.2009.11.013 ↗
50. High-resolution beam steering using microlens arrays10.1364/OL.31.002861 ↗
51. Ayers, G.J., Ciampa, M.A., and Vranos, N.A. (2011, January 9–13). Holographic Optical Beam Steering Demonstration. Proceedings of the IEEE Photonic Society 24th Annual Meeting, Arlington, VA, USA.
52. MEMS-based lidar for autonomous driving10.1007/s00502-018-0635-2 ↗
53. Ullrich, A., Pfennigbauer, M., and Rieger, P. (2013). How to read your LIDAR spec—A comparison of single-laser-output and multi-laser-output LIDAR instruments. Riegl Laser Measurement Systems, GmbH Riegl.
54. Evolution of an Artificial Neural Network Based Autonomous Land Vehicle Controller10.1109/3477.499795 ↗
55. Development of autonomous car—Part I: Distributed system architecture and development process10.1109/TIE.2014.2321342 ↗
56. Hail, robo-taxi!10.1109/MSPEC.2017.7802740 ↗
57. A dual-axis pointing mirror with moving-magnet actuation10.1088/0960-1317/23/2/025002 ↗
58. Ye, L., Zhang, G., and You, Z. (2017). 5 V compatible two-axis PZT driven MEMS scanning mirror with mechanical leverage structure for miniature LiDAR application. Sensors, 17.10.3390/s17030521 ↗
59. Large deflection micromechanical scanning mirrors for linear scans and pattern generation10.1109/2944.892609 ↗
60. Progress on MEMS-scanned ladar10.1117/12.2223728 ↗
61. Design and implementation of 3d lidar based on pixel-by-pixel scanning and ds-ocdma10.1117/12.2251189 ↗
62. MEMS laser scanners: A review10.1109/JMEMS.2013.2295470 ↗
63. Optical performance requirements for MEMS-scanner-based microdisplays10.1117/12.396486 ↗
64. Two-axis electromagnetic microscanner for high resolution displays10.1109/JMEMS.2006.879380 ↗
65. Study of two-dimensional scanning LIDAR for planetary explorer10.1117/12.800791 ↗
66. Park, I., Jeon, J., Nam, J., Nam, S., Lee, J., Park, J., Yang, J., Ebisuzaki, T., Kawasaki, Y., and Takizawa, Y. (2009). A new LIDAR method using MEMS micromirror array for the JEM-EUSO mission. Proceedings of the 31st ICRC Conference, Lodz 2009, Commission C4, IUPAP.
67. Low-cost compact MEMS scanning ladar system for robotic applications10.1117/12.919804 ↗
68. Riu, J., and Royo, S. (2018). A compact long-range lidar imager for high spatial operation in daytime. Proceedings of the 8th International Symposium on Optronics in Defence and Security, 3AF—The French Aerospace Society.
69. Highly integrated optical phased arrays: Photonic integrated circuits for optical beam shaping and beam steering10.1515/nanoph-2015-0152 ↗
70. Hansen, R.C. (2009). Phased Array Antennas, John Wiley & Sons.10.1002/9780470529188 ↗
71. High-resolution aliasing-free optical beam steering10.1364/OPTICA.3.000887 ↗
72. Large-scale nanophotonic phased array10.1038/nature11727 ↗
73. Off-chip beam steering with a one-dimensional optical phased array on silicon-on-insulator10.1364/OL.34.001477 ↗
74. Eldada, L. (, 2018). Solid state LIDAR for ubiquitous 3D sensing, Quanergy Systems. Proceedings of the GPU Technology Conference.
75. Challenges in miniaturized automotive long-range lidar system design
76. Two-dimensional beam steering using a thermo-optic silicon photonic optical phased array10.1117/1.OE.55.11.111603 ↗
77. 3D flash LIDAR vision systems for imaging in degraded visual environments
78. Rohrschneider, R., Masciarelli, J., Miller, K.L., and Weimer, C. (2013, January 19–22). An overview of ball flash LiDAR and related technology development. Proceedings of the AIAA Guidance, Navigation, and Control Conference, American Institute of Aeronautics And Astronautics, Boston, MA, USA.10.2514/6.2013-4642 ↗
79. Carrara, L., and Fiergolski, A. (2019). An Optical Interference Suppression Scheme for TCSPC Flash LiDAR Imagers. Appl. Sci., 9.10.3390/app9112206 ↗
80. Flash lidar based on multiple-slit streak tube imaging lidar
81. A comparison flash lidar detector options10.1117/12.2229068 ↗
82. (2018). Continental Showcases Innovations in Automated Driving, Electrification and Connectivity. Automotive Engineering Exposition 2018 Yokohama, Japan, Continental Automotive Corporation. Available online: https://www.continental.com/resource/blob/129910/d41e02236f04251275f55a71a9514f6d/press-release-data.pdf.
83. Christian, J.A., and Cryan, S. (2013). A survey of LIDAR technology and its use in spacecraft relative navigation. Proceedings of the AIAA Guidance, Navigation, and Control Conference, American Institute of Aeronautics And Astronautics.10.2514/6.2013-4641 ↗
84. How 10 leading companies are trying to make powerful, low-cost lidar
85. Jokela, M., Kutila, M., and Pyykönen, P. (2019). Testing and Validation of Automotive Point-Cloud Sensors in Adverse Weather Conditions. Appl. Sci., 9.10.3390/app9112341 ↗
86. Crouch, S. (2018, January 18–21). Advantages of 3D Imaging Coherent Lidar for Autonomous Driving Applications. Proceedings of the 19th Coherent Laser Radar Conference, Okinawa, Japan.
87. The infrared transmission of atmospheric windows10.1016/0016-0032(53)90002-7 ↗
88. International Standard IEC 60825-1 (Safety of Laser Products-Part 1: Equipment Classification and Requirements, 2007). Safety of Laser Products-Part 1: Equipment Classification and Requirements.
89. Coldren, L.A., Corzine, S.W., and Mashanovitch, M.L. (2012). Diode Lasers and Photonic Integrated Circuits, John Wiley & Sons.10.1002/9781118148167 ↗
90. Udd, E., and Spillman, W.B. (2011). Fiber Optic Sensors: An Introduction for Engineers and Scientists, John Wiley & Sons.10.1002/9781118014103 ↗
91. Er3+-Yb3+ and Er3+-doped fibre lasers10.1109/50.39081 ↗
92. Strongly pumped fiber lasers10.1109/3.709573 ↗
93. Bragg grating-based laser sensors systems with interferometric interrogation and wavelength division multiplexing10.1109/50.400692 ↗
94. Fomin, V., Gapontsev, V., Shcherbakov, E., Abramov, A., Ferin, A., and Mochalov, D. (July, January 30). 100 kW CW fiber laser for industrial applications. Proceedings of the IEEE 2014 International Conference Laser Optics, St. Petersburg, Russia.10.1109/LO.2014.6886450 ↗
95. Thermal effects in kilowatt fiber lasers10.1109/LPT.2003.818913 ↗
96. Review of the present status of optical fiber sensors10.1016/S1068-5200(02)00527-8 ↗
97. Paschotta, R. (2010). Field Guide to Optical Fiber Technology, SPIE.10.1117/3.853722 ↗
98. Sennaroglu, A. (2006). Solid-State Lasers and Applications, CRC Press.
99. Solid-state lasers: Status and future10.1364/JOSAB.27.000B93 ↗
100. Q-switched operation of microchip lasers10.1364/OL.16.000575 ↗