Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
SpringerLink
Log in

Online Arabic handwriting recognition: a survey

  • Original Paper
  • Published:
International Journal on Document Analysis and Recognition (IJDAR) Aims and scope Submit manuscript

Abstract

Researches on handwriting recognition have known a great attention since it has been considered as a technological revolution in man-machines interfaces especially that handwriting has continued to persist as the most used mean of communication and recording information in day-to-day life. The challenging nature of handwriting recognition and segmentation has attracted the attention of researchers from academic and industry circles. The huge part of these researches deals with Latin and Chinese. Interest in Arabic script comes years later, and so the state of the art is less advanced. This survey describes the nature of this Arabic handwritten language and the basic concepts behind the recognition process. An overview of the state of the art of online Arabic handwriting recognition is presented. It is based on an extensive review of the literature in order to describe background in the field, discussion of the methods, and future research directions. It is the first survey to focus on online Arabic handwriting recognition and provide recognition rates and descriptions of database used for the discussed approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Tappert C.C., Suen C.Y., Wakahara T.: The state of the art in online handwriting recognition. IEEE Trans. Pattern Anal. Mach. Intell. 12(8), 787–808 (1990)

    Article  Google Scholar 

  2. Plamondon R., Srihari S.N.: On-line and off-line handwriting recognition: a comprehensive survey. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 63–84 (2000)

    Article  Google Scholar 

  3. Graves A., Liwicki M., Fernandez S., Bertolami R., Bunke H., Schmidhuber J.: A novel connectionist system for unconstrained handwriting recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(5), 855–868 (2009)

    Article  Google Scholar 

  4. Graves A., Fernandez S., Liwicki M., Bunke H., Schmidhuber J.: Unconstrained online handwriting recognition with recurrent neural networks. In: Platt, J., Koller, D., Singer, Y., Roweis, S. (eds) Advances in Neural Information Processing Systems, vol. 20, MIT Press, Cambridge (2008)

    Google Scholar 

  5. Bortolozzi, F., Brito, A.S., Oliveira , L.S., Morita, M.: Recent Advances in Handwritten Recognition. In: Pal, U., Parui, S.K., Chaudhuri, B.B. (eds.) Document Analysis, pp 1–30 (2008)

  6. Sternby, J., Morwing, J., Andersson, J., Friberg, C.: On-line Arabic handwriting recognition with templates. Pattern Recogn. J. 42(12), 3278–3286, New Frontiers in Handwriting Recognition (2009)

    Google Scholar 

  7. Schenk, J., Lenz, J., Rigoll, G.: Novel script line identification method for script normalization and feature extraction in on-line handwritten whiteboard note recognition. Pattern Recogn. J., 42(12), pp. 3383–3393, New Frontiers in Handwriting Recognition (2009)

    Google Scholar 

  8. Liu C., Nakagawa M.: Online recognition of Chinese characters: the state-of-the-art. IEEE Trans. Pattern Anal. Mach. Intell. 26, 198–213 (2004)

    Article  Google Scholar 

  9. Khan, K.U., Haider, I.: Online recognition of multi-stroke handwritten Urdu characters. In: International Conference on Image Analysis and Signal Processing (IASP), pp. 284–290 (2010)

  10. Njah, S., Bezine, H., Alimi, A.M.: A new encoding system: application to on-line Arabic handwriting. In: Proceedings of ICFHR 2010, pp. 451–456 (2010)

  11. Kessentini, Y., Paquet, T., Ben Hamadou, A.: A multi-lingual recognition system for Arabic and Latin handwriting. In: ICDAR, 2009 10th International Conference on Document Analysis and Recognition, pp. 1196–1200 (2009)

  12. Amin, A.: Off line Arabic character recognition—a survey. In: Fourth International Conference Document Analysis and Recognition (ICDAR’97), p. 596 (1997)

  13. Khorsheed M.S: Off-Line Arabic character recognition—a review. Pattern Anal. Appl. 5(1), 31–45 (2002)

    Article  MathSciNet  Google Scholar 

  14. Lorigo L., Govindaraju V.: Offline Arabic handwriting recognition: a survey. Trans. Pattern Anal. Mach. Intell. 28(5), 712–724 (2006)

    Article  Google Scholar 

  15. Märgner, V., El Abed, H.: Arabic and Chinese handwriting recognition. In: Databases and Competitions: Strategies to Improve Arabic Recognition Systems, vol. 4768. Springer, LNCS (2008)

  16. Elbaati, A., Kherallah, M., Alimi, A.M., Ennaji, A.: Restoration of the temporal order of the off-line handwriting using genetic algorithm. In: 4th International Conference on Computer Science Practice in Arabic (CSPA) (2008)

  17. Elbaati, A., Kherallah, M., El Abed, H., Ennaji, A., Alimi, A.M.: Arabic handwriting recognition using restored stroke chronology. In: International Conference on Document Analysis and Recognition (ICDAR) (2009)

  18. Hamdani, M., El Abed, H., Kherallah, M., Alimi, A.M.: Combining multiple hmms using on-line and off-line features for off-line arabic handwriting recognition. In: International Conference on Document Analysis and Recognition (ICDAR) (2009)

  19. Dimauro, G., Impedovo, S., Pirlo, G., Salzo, A.: Automatic Bankcheck Processing: A New Engineered System. In: Impedovo, S., Wang, P.S.P., Bunke, H. (eds.) Machine Perception and Artificial Intelligence, vol. 28, pp. 5–42. World Scientific, Singapore (1997)

  20. Jin, J., Wang, H., Ding, X., Peng, L.: Printed Arabic document recognition system. In: Proceedings of SPIE-IS&T Electronic Imaging, vol. 5676, pp. 48–55 (2005)

  21. Earnest, L.D.: Machine Reading of Cursive Script. IFIP Congress, pp. 462–466, Amsterdam (1963)

  22. Eden, M.: Handwriting and pattern recognition. Inf. Theory IRE Trans. 8(2), 160–166 (1962)

  23. Scholey, I.: Digitizer technology Comparison: inductive and resistive technology. Pen Comput. Mag. (2006). http://pencomputing.com/features/wacomdigitizercomparison.html

  24. Fujitsu laboratories: Fujitsu—The Possibilities are Infinite, Ultrasound Electronic Pen (2005)

  25. Wacom Technology.: Wacom Components: Technology: EMR Technology (2006). http://www.wacom-components.com/english/technology/emr.html

  26. http://www.parascript.com/

  27. http://thenextweb.com/insider/2011/10/22/how-one-of-apples-most-important-pieces-of-software-came-from-a-small-uk-startup/

  28. http://www.visionobjects.com/en/about-us/vision-objects/about-vision-objects/

  29. http://www.mobidiv.com/

  30. Kherallah, M., Tagougui, N., Alimi, A.M., Elabed, H., Märgner, V.: Online Arabic handwriting recognition competition. In: Proceedings of ICDAR 2011, pp. 1454–1459 (2011)

  31. http://axiotron.com/index.php?id=quickscript

  32. Jain, A.K., Duin, R.P.W., Mao, J.: Statistical pattern recognition: a review. IEEE Trans. PAMI 22, 4–3 (2000)

    Google Scholar 

  33. Bouslama, F., Amin, A.: Pen-based recognition system of Arabic character utilizing structural and fuzzy techniques. In: Proceedings of Second International Conference on Knowledge-Based Intelligent Electronic Systems, pp. 76–85 (1998)

  34. Abdelazim, H.Y.: Recent trends in Arabic OCR. In: Conference of engineering language, Ain Shams University (2005)

  35. Mezghani N., Mitiche A., Cheriet M.: Bayes classification of online Arabic characters by Gibbs modeling of class conditional densities. IEEE Trans. Pattern Anal. Mach. Intell. 30(7), 1121–1131 (2008)

    Article  Google Scholar 

  36. Mezghani, N., Mitiche, A., Cheriet, M.: Combination of pruned Kohonen maps for on-line Arabic characters recognition. In: Proceedings of ICDAR’03, pp. 900–905, Edinburgh (2003)

  37. Daifallah, K., Zarka, N., Jamous, H.: Recognition-based segmentation algorithm for on-line Arabic handwriting. In: Proceedings of International Conference on Document Analysis and Recognition, ICDAR 2009, pp. 877–880. Barcelona, Spain, IEEE (2009)

  38. Izadi, S., Haji, M., Suen, C.Y.: A new segmentation algorithm for online handwritten word recognition in Persian script. pp. 1140–1142, ICHFR (2008)

  39. Husain S.A., Sajjad A., Anwar, F.: Online Urdu character recognition system. In: IAPR Conference on Machine Vision Applications, Japan (2007)

  40. Boubaker, H., Elbaati, A., Kherallah, M., Alimi, A.M., Elabed, H.: Online Arabic handwriting modeling system based on the graphemes segmentation. In: Proceedings of ICPR 2010, pp. 2061–2064 (2010)

  41. Boubaker, H., Kherallah, M., Alimi, A.M.: New algorithm of straight or curved baseline detection for short arabic handwritten writing. In: ICDAR, 2009 10th International Conference on Document Analysis and Recognition, pp. 778–782 (2009)

  42. Kherallah M., Haddad L., Alimi A.M., Mitiche A.: Online handwritten digit recognition based on trajectory and velocity modeling. Pattern Recogn. Lett. 29, 580–594 (2008)

    Article  Google Scholar 

  43. Biadsy, F., El-Sana, J., Habash, N.: Online Arabic handwriting recognition using hidden Markov models. In: Proceedings of the Tenth International Workshop on Frontiers in Handwriting Recognition, pp. 85–90 (2006)

  44. Saabni, R., El-Sana, J.: Hierarchical on-line Arabic handwriting recognition. In: Proceedings of the 10th International Conference on Document Analysis and Recognition, ICDAR 2009, pp. 1251–1254. Barcelona, Spain, IEEE (2009)

  45. Razzak, M.I., Hussain, S.A., Sher, M.: Combining online and offline preprocessing for online Urdu character recognition. In: International Multiconference of Engineers and Computer Scientists (IMECS 09), Hong Kong (2009)

  46. Al-Taani, A., Hammad, M.: Recognition of on-line handwritten Arabic digits using structural features and transition network. Informatica 32, 275–281 (2008)

    Google Scholar 

  47. Al-Habian, G., Assaleh, K.: Online Arabic handwriting recognition using continuous Gaussian mixture HMMs. In: Proceedings of International Conference on Intelligent and Advanced Systems (ICIAS), pp. 1183–1186 (2007)

  48. Eraqi, H., Abdelazeem, S.: An on-line Arabic handwriting recognition system based on a new on-line graphemes segmentation technique. In: Proceedings of ICDAR 2011, pp. 409–413 (2011)

  49. Al- Taani, A., Al- Haj, S.: Recognition of on-line arabic handwritten characters using structural features. J. Pattern Recogn. Res., pp. 23–37 (2010)

  50. Razzak M.I., Anwar F., Husain S.A., Belaid A., Sher M.: HMM and fuzzy logic: a hybrid approach for online Urdu script-based languages’ character recognition. Knowl. Based Syst. 23(8), 914–923 (2010)

    Article  Google Scholar 

  51. Elanwar, R.I., Rashwan, M.A., Mashali, S.A.: Simultaneous segmentation and recognition of Arabic characters in an unconstrained on-line cursive handwritten document. In: Proceedings of World Academy of Science, Engineering and Technology (WASET), International conference on Machine learning and Pattern Recognition MLPR2007, vol. 23, pp. 288–291, Germany (2007)

  52. Abdelazeem, S., Eraqi, H.: On-line Arabic handwritten personal names recognition system based on HMM. In: Proceedings of ICDAR 2011, pp. 1304–1308 (2011)

  53. Razzak M.I., Sher M., Hussain S.A.: Locally baseline detection for online Arabic script based languages character recognition. Int. J. Phys. Sci. 5(7), 955–959 (2010)

    Google Scholar 

  54. Biadsy F., Saabni R., EL-Sana J.: Segmentation-free online Arabic handwriting recognition. Int. J. Pattern Recognit. Artif. Intell. 25(7), 1009–1033 (2011)

    Article  Google Scholar 

  55. Alimi, A.M., Ghorbel, O.A.: The analysis of error in an on-line recognition system of arabic handwritten character. In: Proceedings of ICDAR’95, vol. 2, pp. 890–893 (1995)

  56. Alimi, A.M.: An evolutionary neuro-fuzzy approach to recognize on-line Arabic handwriting. In: Proceedings of International Conference on Document Analysis and Recognition, vol. 1, pp. 382–386 (1997)

  57. Kherallah M., Bouri F., Alimi A.: On-line Arabic handwriting recognition system based on visual encoding and genetic algorithm. J. Eng. Appl. Artif. Intell. 22(1), 153–170 (2009)

    Article  Google Scholar 

  58. Ahmed, H., Abdel Azeem, S.: On-line Arabic handwriting recognition system based on HMM. In: Proceedings of ICDAR 2011, pp. 1324–1328 (2011)

  59. Ghods, V., Kabir, E.: Feature extraction for online Farsi characters. In: ICFHR, 2010 12th International Conference on Frontiers in Handwriting Recognition, pp. 477–482 (2010)

  60. Kherallah M., Elbaati A., El Abed H., Alimi, A.M.: The on/off (LMCA) dual Arabic handwriting database. In: 11th International Conference on Frontiers in Handwriting Recognition (ICFHR) (2008)

  61. Jouini, B., Kherallah, M., Alimi, M.A.: A new approach for online visual encoding and recognition of handwriting script by using neural network system. In: 6th International Conference on. Artificial Neural Nets and Genetic Algorithms, pp. 161–166. Springer, Vienna (2003)

  62. Halavati R., Jamzad M., Soleymani M.: A novel approach to persian online hand writing recognition. Trans. Eng. Comput. Technol. 6, 232–236 (2005)

    Google Scholar 

  63. Boubaker, H., Chaabouni, A., Kherallah, M., Alimi, A.M., El Abed, H.: Fuzzy segmentation and graphemes modeling for online Arabic handwriting recognition. In: Proceedings of ICFHR 2010, pp. 695–700 (2010)

  64. Boubaker, H., Kherallah, M., Alimi, A.M.: New strategy for the on-line handwriting modeling. In: Proceedings of Ninth International Conference on Document Analysis and Recognition (ICDAR), vol. 2, pp. 1233–1247, 23–26 September (2007)

  65. Kherallah, M., Njah, S., Alimi, A.M., Derbel, N.: Recognition of on-line handwritten digits by neural networks using circular and Beta approaches. In: Proceedings of IEEE International Conference SMC’02, pp. 26–30. Hammamet, Tunisia (2002)

  66. Al-Emami S., Usher M.: On-line recognition of handwritten Arabic characters. IEEE Trans. Pattern Anal. Mach. Intell. 12(7), 704–710 (1990)

    Article  Google Scholar 

  67. Malaviya, A., Peters, L., Camposano, R.: A fuzzy online handwriting recognition system: FOHRES. In: Second international conference on Fuzzy Theory and Technology, Durham, NC, October, pp. 13–16 (1993)

  68. Baghshah, M.S., Shouraki, S.B., Kasaei, S.: A novel fuzzy classifier using fuzzy LVQ to recognize online persian handwriting. In: 2nd IEEE Conference on Information & Communication Technologies (ICTTA) (2006)

  69. Schurmann J.: Pattern classification: a unified view of statistical and neural approaches. John Wiley & Sons, Inc., New York (1996)

    Google Scholar 

  70. Assaleh K., Shanableh T., Hajjaj H.: Recognition of handwritten Arabic alphabet via hand motion tracking. J. Franklin Inst. 346(2), 175–189 (2009)

    Article  MATH  Google Scholar 

  71. Abuzaraida, M.A., Zeki, A.M.: Segmentation techniques for online Arabic handwriting recognition: a survey. In: Proceedings of 3rd International Conference on ICT4M (2010)

  72. Amin, A., Kaced, A., Haton J., Mohr, R.: Handwriting written Arabic character recognition by the IRAC system. In: Proceedings of International Conference on Pattern Recognition, pp. 729–731. Miami, Florida, USA (1980)

  73. Al-Sheikh T., El-Taweel S.: Real-time arabic handwritten character recognition. Pattern Recogn. 23(12), 1323–1332 (1990)

    Article  Google Scholar 

  74. Mahjoub, M.A.: Apport de la modélisation de la durée d’état dans la reconnaissance en-ligne des caractères arabes par HMMs. In: Proceedings of 17th Journée Tunisienne en Electrotechnique et Automatique, pp. 341–348 (1997)

  75. Hafsa, W., Kherallah, M., Ben Jemaa, M., Ben Amara, N.: A hybrid approach of neural networks/hidden markov model for on-line recognition of the Arabic digits. In: Proceedings of IEEE International Conference on SCS’04, pp. 137–141. Mounastir, Tunisia (2004)

  76. Ahmad, A.R.: Reconnaissance de l’écriture manuscrite en ligne par approche combinant systèmes à à vastes marges et modèles de Markov cachés?, université de Nantes, December (2008)

  77. Amin, A.: Machine recognition of handwritten Arabic words by the IRAC II System. In: Proceedings of the 6th International Joint Conference on Pattern Recognition, pp. 34–36. Munich, F.R.G, October (1982)

  78. Amin, A., Masini, G., Haton, J.: Recognition of handwritten Arabic words and sentences. In: Proceedings of the 7th International Joint Conference on Pattern Recognition, pp. 1055–1057. Montréal, Canada, October (1984)

  79. El-Wakil M.S., Shoukry A.A.: On-line recognition of handwritten Arabic character recognition. Pattern Recogn. 22(2), 97–105 (1989)

    Article  Google Scholar 

  80. Gader, P., Keller, J.M: Fuzzy methods in handwriting recognition: an overview. In: Biennial Conference of the North American Fuzzy Information Processing Society, pp. 137–141 (1996)

  81. Alsallakh, B., Safadi, H.: AraPen: an Arabic online handwriting recognition system. Information and communication technologies, 2006. In: Proceedings of ICTTA ’06. 2nd Issue, pp.~1844–1849 (2006)

  82. Mico L., Oncina J.: Comparison of fast nearest neighbor classifier for handwritten character recognition. Pattern Recogn. Lett. 19, 351–356 (1999)

    Article  Google Scholar 

  83. Rabiner, L., Juang, R., Levinson, B.H.: An introduction to hidden Markov models. ASSP Mag. IEEE, 3(1), 4–16 (1986)

  84. Cristianini N., Shawe-Taylor J.: An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press, Cambridge (2000)

    Book  Google Scholar 

  85. Burges, C.J: Simplified support vector decision rules. In: Saitta, L. (ed), 13th International Conference on Machine Learning. San Mateo, California, Morgan Kaufmann (1996)

  86. Cheriet M., El-Yacoubi M.A., Fujisawa H., Lopresti D.P., Lorette G.: Handwriting recognition research: twenty years of achievement... and beyond. Pattern Recogn. 42(12), 3131–3135 (2009)

    Article  Google Scholar 

  87. Indermühle, E., Liwicki, M., Bunke, H.: IAMonDo-database: an Online Handwritten Document Database with Non-uniform Contents. In: Proceedings of the 9th IAPR International Workshop on Document Analysis Systems (DAS ’10), pp. 97–104, USA (2010)

  88. Pechwitz, M., Maddouri, S., Märgner, V., Ellouze, N., Amiri, H.: IFN/ENIT—database of handwritten Arabic words. In: Proceedings of CIFED 2002, pp. 129–136 (2002)

  89. Ziaratban, M., Faez, K., Bagheri, F.: FHT: an unconstraint Farsi handwritten text database. In: 10th International Conference on Document Analysis and Recognition, pp. 281–285 (2009)

  90. Mahmoud S.A., Ahmad I., Alshayeb M.: A database for offline Arabic handwritten text recognition. Lect. Notes Comput. Sci. 6754/2011, 397–406 (2011)

    Article  Google Scholar 

  91. El Abed, H., Märgner V., Kherallah, M., Alimi, A.M.: ICDAR 2009 online Arabic handwriting recognition competition. In: ICDAR, 2009 10th International Conference on Document Analysis and Recognition, pp. 1388–1392 (2009)

  92. Boubaker, H., Tagougui, N., Elbaati, A., Kherallah, M., Elabed, H., Alimi, A.M.: Online Arabic databases and applications. In: Märgner, V., El Abed, H. (eds) Guide to OCR for Arabic Scripts Chp. Part IV: applications, Springer (to appear)

  93. El Abed, H., kherallah, M., Mârgner, V., Alimi, A.M.: On-line Arabic handwriting recognition competition ADAB database and participating systems. Int. J. Doc. Anal. Recogn. 14(1), 15–23 (2010)

    Google Scholar 

  94. http://www.altec-center.org/conference/?page_id=87

  95. Elanwar, R.I., Rashwan, M.A., Mashali, S.A.: OHASD: the first on-line Arabic sentence database handwritten on tablet PC. In: Proceedings of World Academy of Science, Engineering and Technology (WASET), International conference on International Conference on Signal and Image Processing ICSIP 2010, vol. 69, pp. 910–915, Singapore (2010)

  96. Märgner, V., Pechwitz, M., El Abed, H.: ICDAR 2005 Arabic handwriting recognition competition. In: 8th International Conference on Document Analysis and Recognition (ICDAR), vol. 1, pp. 70–74 (2005)

  97. Märgner, V., El Abed, H.: ICDAR 2007 Arabic handwriting recognition competition. In: 9th International Conference On Document Analysis and Recognition (ICDAR), vol. 2, pp. 1274–1278 (2007)

  98. Duda R.O., Hart P.E., Stork D.G: Pattern Classification. Wiley, New York (2001)

    MATH  Google Scholar 

  99. Mezghani, N., Mitiche, A., Cheriet, M.: On-line recognition of handwritten Arabic characters using a Kohonen neural network. In: Proceedings of IWFHR’02, pp. 490–495. Niagara-on-the-Lake, Canada (2002)

  100. Alimi, A.M.: Evolutionary computation for the recognition of on-line cursive handwriting. IETE J. Res. 48(5) SPEC., 385–396 (2002)

    Google Scholar 

  101. Beigi, H.M., Nathan, K., Clary, G.J., Subrahmonia, J.: Challenges of handwriting recognition in Farsi, Arabic and other languages with similar writing styles (an on-line digit recognizer). In: Proceedings of the 2nd Annual Conference on Technological Advancements in Developing Countries, Columbia University, New York, July 23–24 (1994)

  102. Shahzad, N., Paulson, B., Hammond, T.: Urdu Qaeda: recognition system for isolated Urdu characters, 2009 Intelligent User Interfaces (IUI 2009) Workshop on Sketch Recognition (Long Talks), Sanibel Island, Florida, February 8–11 (2009)

Download references

Author information

Authors and Affiliations

  1. Research Group on Intelligent Machines (REGIM), National School of Engineers ENIS, University of Sfax, BP 1173, 3038, Sfax, Tunisia

    Najiba Tagougui, Monji Kherallah & Adel M. Alimi

Authors
  1. Najiba Tagougui
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Monji Kherallah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Adel M. Alimi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Najiba Tagougui.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tagougui, N., Kherallah, M. & Alimi, A.M. Online Arabic handwriting recognition: a survey. IJDAR 16, 209–226 (2013). https://doi.org/10.1007/s10032-012-0186-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10032-012-0186-8

Keywords

Search

Navigation