Abstract
In this paper we present an algorithm for performance characterization of symbol localization systems. This algorithm is aimed to be a more “reliable” and “open” solution to characterize the performance. To achieve that, it exploits only single points as the result of localization and offers the possibility to reconsider the localization results provided by a system. We use the information about context in groundtruth, and overall localization results, to detect the ambiguous localization results. A probability score is computed for each matching between a localization point and a groundtruth region, depending on the spatial distribution of the other regions in the groundtruth. Final characterization is given with detection rate/probability score plots, describing the sets of possible interpretations of the localization results, according to a given confidence rate. We present experimentation details along with the results for the symbol localization system of [1], exploiting a synthetic dataset of architectural floorplans and electrical diagrams (composed of 200 images and 3861 symbols).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Qureshi, R., Ramel, J., Barret, D., Cardot, H.: Symbol spotting in graphical documents using graph representations. In: Liu, W., Lladós, J., Ogier, J.-M. (eds.) GREC 2007. LNCS, vol. 5046, pp. 91–103. Springer, Heidelberg (2008)
Valveny, E., Tabbone, S., Ramos, O., Philippot, E.: Performance characterization of shape descriptors for symbol representation. In: Liu, W., Lladós, J., Ogier, J.-M. (eds.) GREC 2007. LNCS, vol. 5046, pp. 278–287. Springer, Heidelberg (2008)
Delalandre, M., Valveny, E., Lladós, J.: Performance evaluation of symbol recognition and spotting systems: An overview. In: Workshop on Document Analysis Systems (DAS), pp. 497–505 (2008)
Rusiñol, M., Lladós, J.: A performance evaluation protocol for symbol spotting systems in terms of recognition and location indices. International Journal on Document Analysis and Recognition (IJDAR) 12(2), 83–96 (2009)
Delalandre, M., Pridmore, T., Valveny, E., Trupin, E., Locteau, H.: Building synthetic graphical documents for performance evaluation. In: Liu, W., Lladós, J., Ogier, J.-M. (eds.) GREC 2007. LNCS, vol. 5046, pp. 288–298. Springer, Heidelberg (2008)
Locteau, H., Adam, S., Trupin, E., Labiche, J., Heroux, P.: Symbol spotting using full visibility graph representation. In: Liu, W., Lladós, J., Ogier, J.-M. (eds.) GREC 2007. LNCS, vol. 5046, pp. 49–50. Springer, Heidelberg (2008)
Unnikrishnan, R., Pantofaru, C., Hebert, M.: Toward objective evaluation of image segmentation algorithms. Pattern Analysis and Machine Intelligence (PAMI) 29(6), 929–944 (2007)
Breuel, T.: Representations and metrics for off-line handwriting segmentation. In: International Workshop on Frontiers in Handwriting Recognition (IWFHR), pp. 428–433 (2002)
Bridson, D., Antonacopoulos, A.: A geometric approach for accurate and efficient performance evaluation. In: International Conference on Pattern Recognition (ICPR), pp. 1–4 (2008)
Wenyin, L., Dori, D.: A proposed scheme for performance evaluation of graphics/text separation algorithms. In: Chhabra, A.K., Tombre, K. (eds.) GREC 1997. LNCS, vol. 1389, pp. 335–346. Springer, Heidelberg (1998)
Kanungo, T., Resnik, P.: The bible, truth, and multilingual ocr evaluation. In: Document Recognition and Retrieval (DRR). SPIE Proceedings, vol. 3651, pp. 86–96 (1999)
Balaban, I.: An optimal algorithm for finding segments intersections. In: Symposium on Computational Geometry (SGC), pp. 211–219 (1995)
Kanungo, T., Haralick, R.M., Phillips, I.: Non-linear local and global document degradation models. International Journal of Imaging Systems and Technology (IJIST) 5(3), 220–230 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Delalandre, M., Ramel, JY., Valveny, E., Luqman, M.M. (2010). A Performance Characterization Algorithm for Symbol Localization. In: Ogier, JM., Liu, W., Lladós, J. (eds) Graphics Recognition. Achievements, Challenges, and Evolution. GREC 2009. Lecture Notes in Computer Science, vol 6020. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13728-0_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-13728-0_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13727-3
Online ISBN: 978-3-642-13728-0
eBook Packages: Computer ScienceComputer Science (R0)