Abstract
The manuscript evaluates the performance of a monocular visual odometry approach when images from different spectra are considered, both independently and fused. The objective behind this evaluation is to analyze if classical approaches can be improved when the given images, which are from different spectra, are fused and represented in new domains. The images in these new domains should have some of the following properties: i) more robust to noisy data; ii) less sensitive to changes (e.g., lighting); iii) more rich in descriptive information, among other. In particular in the current work two different image fusion strategies are considered. Firstly, images from the visible and thermal spectrum are fused using a Discrete Wavelet Transform (DWT) approach. Secondly, a monochrome threshold strategy is considered. The obtained representations are evaluated under a visual odometry framework, highlighting their advantages and disadvantages, using different urban and semi-urban scenarios. Comparisons with both monocular-visible spectrum and monocular-infrared spectrum, are also provided showing the validity of the proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Geronimo, D., Lopez, A.M., Sappa, A.D., Graf, T.: Survey of pedestrian detection for advanced driver assistance systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(7), 1239–1258 (2010)
Hwang, S., Park, J., Kim, N., Choi, Y., Kweon, I.S.: Multispectral pedestrian detection: benchmark dataset and baseline. In: IEEE International Conference on Computer Vision and Pattern Recognition (2015)
Barrera, F., Lumbreras, F., Sappa, A.D.: Multimodal stereo vision system: 3D data extraction and algorithm evaluation. IEEE Journal of Selected Topics in Signal Processing 6(5), 437–446 (2012)
Barrera, F., Lumbreras, F., Sappa, A.D.: Multispectral piecewise planar stereo using manhattan-world assumption. Pat. Recognition Letters 34(1), 52–61 (2013)
Conaire, C.O., O’Connor, N.E., Cooke, E., Smeaton, A.: Multispectral object segmentation and retrieval in surveillance video. In: IEEE International Conference on Image Processing, pp. 2381–2384 (2006)
Denman, S., Lamb, T., Fookes, C., Chandran, V., Sridharan, S.: Multi-spectral fusion for surveillance systems. Comp. & Electrical Engineering 36(4), 643–663 (2010)
Nistér, D., Naroditsky, O., Bergen, J.: Visual odometry. In: IEEE Intgernational Conference on Computer Vision and Pattern Recognition, vol. 1, pp. I–652 (2004)
Scaramuzza, D., Fraundorfer, F., Siegwart, R.: Real-time monocular visual odometry for on-road vehicles with 1-point RANSAC. In: IEEE International Conference on Robotics and Automation, pp. 4293–4299 (2009)
Tardif, J.P., Pavlidis, Y., Daniilidis, K.: Monocular visual odometry in urban environments using an omnidirectional camera. In: IEEE International Conference on Intelligent Robots and Systems IROS, pp. 2531–2538 (2008)
Howard, A.: Real-time stereo visual odometry for autonomous ground vehicles. In: International Conference on Intelligent Robots and Systems, pp. 3946–3952 (2008)
Scaramuzza, D., Fraundorfer, F.: Visual odometry. IEEE Robotics & Automation Magazine 18(4), 80–92 (2011)
Comport, A.I., Malis, E., Rives, P.: Accurate quadrifocal tracking for robust 3D visual odometry. In: IEEE International Conference on Robotics and Automation, ICRA, Roma, Italy, April 10–14, 2007, pp. 40–45 (2007)
Chilian, A., Hirschmüller, H.: Stereo camera based navigation of mobile robots on rough terrain. In: IEEE International Conference on Intelligent Robots and Systems IROS, pp. 4571–4576. IEEE (2009)
Nilsson, E., Lundquist, C., Schön, T., Forslund, D., Roll, J.: Vehicle motion estimation using an infrared camera. In: 18th IFAC World Congress, Milano, Italy, 28 August–2 September 2011, pp. 12952–12957. Elsevier (2011)
Mouats, T., Aouf, N., Sappa, A.D., Aguilera-Carrasco, C.A., Toledo, R.: Multispectral stereo odometry. IEEE Transactions on Intelligent Transportation Systems 16(3), 1210–1224 (2015)
Amolins, K., Zhang, Y., Dare, P.: Wavelet based image fusion techniques – an introduction, review and comparison. ISPRS Journal of Photogrammetry and Remote Sensing 62(4), 249–263 (2007)
Suraj, A., Francis, M., Kavya, T., Nirmal, T.: Discrete wavelet transform based image fusion and de-nosing in FPGA. Journal of Electriacal Systems and Information Technology 1, 72–81 (2014)
Rasmussen, N.D., Morse, B.S., Goodrich, M., Eggett, D., et al.: Fused visible and infrared video for use in wilderness search and rescue. In: Workshop on Applications of Computer Vision (WACV), pp. 1–8. IEEE, December 2009
Geiger, A., Ziegler, J., Stiller, C.: Stereoscan: dense 3D reconstruction in real-time. In: Intelligent Vehicles Symposium (IV) (2011)
Bouguet, J.Y.: Camera calibration toolbox for matlab, July 2010
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Poujol, J., Aguilera, C.A., Danos, E., Vintimilla, B.X., Toledo, R., Sappa, A.D. (2016). A Visible-Thermal Fusion Based Monocular Visual Odometry. In: Reis, L., Moreira, A., Lima, P., Montano, L., Muñoz-Martinez, V. (eds) Robot 2015: Second Iberian Robotics Conference. Advances in Intelligent Systems and Computing, vol 417. Springer, Cham. https://doi.org/10.1007/978-3-319-27146-0_40
Download citation
DOI: https://doi.org/10.1007/978-3-319-27146-0_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27145-3
Online ISBN: 978-3-319-27146-0
eBook Packages: Computer ScienceComputer Science (R0)