Natural Language Processing Resources for the Kashmiri Language

Nawaz Ali Lone; Kaiser J Giri; Rumaan Bashir

doi:10.17485/IJST/v15i43.1964

Article

Natural Language Processing Resources for the Kashmiri Language

VIEWS 1679
PDF 248

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v15i43.1964

Year: 2022, Volume: 15, Issue: 43, Pages: 2275-2281

Original Article

Natural Language Processing Resources for the Kashmiri Language

Nawaz Ali Lone¹, Kaiser J Giri^2*, Rumaan Bashir²

¹Research Scholar, Department of Computer Science, Islamic University of Science & Technology, Kashmir
²Associate Professor, Department of Computer Science, Islamic University of Science & Technology, Kashmir

*Corresponding Author
Email: [email protected]

Received Date:30 September 2022, Accepted Date:11 October 2022, Published Date:16 November 2022

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Objectives: The main objective of this paper as a maiden attempt is to identify the basic resources necessary for undertaking Natural Language Processing (NLP) specific research activities pertaining to Kashmiri language. The paper also deliberates on key issues related to Natural Language Processing of Kashmiri language such as complex linguistic phenomena, the lack of standard linguistic tools, documented as well as standardized resources and the influence of some dominant languages mostly Urdu and English on Kashmiri language. Methods: As there is no substantial work reported in literature specific to NLP of Kashmiri language, a holistic research strategy was adopted to explore the possible sources as potential means for creation of basic resources to undertake the NLP research for Kashmiri language. Findings: After thorough investigation, it was observed that there has been some trivial work reported in the literature related to Machine Translation of Kashmiri language. Further there are few newspapers published in Kashmiri language which can be used as a means for creation of Kashmiri corpus. Moreover crowdsourcing could be used a potential means for development of digital linguistic resources for Kashmiri language. Novelty: The present study is a maiden attempt towards identification of NLP resources for Kashmiri language and will be of immense importance for the research community interested to work for development of Kashmiri language in digital domain.

Keywords: Natural Language Processing; Transliteration; Kashmiri Language; Scheduled Languages; crowdsource; Tag set; P-o-S Tagging

References

Martinez REL, Sierra G. Research Trends in the International Literature on Natural Language Processing, 2000-2019 - A Bibliometric Study. Journal of Scientometric Research. 2020;9(3):310–318. Available from: https://doi.org/10.5530/jscires.9.3.38
Gupta V, Joshi N, Mathur I. Advanced Machine Learning Techniques in Natural Language Processing for Indian Languages. Smart Techniques for a Smarter Planet. 2019;374:117–144. Available from: https://doi.org/10.1007/978-3-030-03131-2_7
Languages of India. Available from: https://en.wikipedia.org/wiki/Languages_of_India
Rajan A, Salgaonkar A, Joshi R. A survey of Konkani NLP resources. Computer Science Review. 2020;38:100299. Available from: https://doi.org/10.1016/j.cosrev.2020.100299
Kashmiri language. Available from: https://en.wikipedia.org/wiki/Kashmiri_language
Koshur: An Introduction to Spoken Kashmiri. Available from: https://www.koshur.org/
Snedden C. Understanding Kashmir and Kashmiris. Choice Reviews Online. 2016;53(08). Available from: http://dx.doi.org/10.5860/choice.195226
Shakil M. The languages of Erstwhile State of. Jammu & Kashmir. Academia. edu. 2011. Available from: https://www.academia.edu/en/6485567/Languages_of_Erstwhile_State_of_Jammu_Kashmir_A_Preliminary_Study_
Scheduled Languages of India. Available from: https://en.wikipedia.org/wiki/Languages_of_India#Scheduled_languages
The Jammu and Kashmir Official Languages Act, 2020, Ministry of Law and Justice (Legislative Department) New Delhi, The 27th September, 2020. 2020. Available from: https://prsindia.org/files/bills_acts/bills_parliament/2020/Jammu%20and%20Kashmir%20Official%20Languages%20Act,%202020.pdf
Kashmiri made compulsory subject in schools. Available from: https://www.oneindia.com/2008/11/01/kashmiri-made-compulsory-subject-in-schools-1225558278.html
The Sharada Script: Origin and Development. Available from: http://www.koausa.org/Languages/Sharda.html
Kashmiri Alphabet, Pronouncation & Language. Available from: https://omniglot.com/writing/kashmiri.htm
Kashmiri Language: Roots, Evolution and Affinity. Available from: http://www.koausa.org/Languages/Shashi.html
An Introduction To Spoken Kashmiri. Available from: http://www.koshur.org/SpokenKashmiri/Introduction/index.html
Indian Languages Corpora Initiative. Available from: http://sanskrit.jnu.ac.in/projects/ilci.jsp?proj=ilci
TDIL: Technology Development for Indian Languages Programme. Available from: https://tdil.meity.gov.in/
Dash NS, Bhattacharyya P, Pawar JD. The WordNet in Indian Languages. (pp. 1-264) Springer Singapore. 2017.
Baker P, Hardie A, Mcenery T, Cunningham H, Gaizauskas R. EMILLE, A 67-Million Word Corpus of Indic Languages: Data Collection, Mark-up and Harmonisation. 2002;p. 219–225.
Ramamoorthy L, NC, Bhat SM. Central Institute of Indian Languages, Mysore A Gold Standard Kashmiri Raw Text Corpus. Mysore. 2019.
Sangarmal Epaper. Available from: http://epaperdaily.com/indian/sangarmal-kashmir-jak.html
Koshur Akhbar. 2022. Available from: http://www.epaper-hub.com/india/epaper/koshur-akhbar.aspx
Soanmeeraas News Weekly. Available from: https://www.soanmeeraas.in/e-paper
Aadil M, Asger M. English to Kashmiri Transliteration System - A Hybrid Approach. International Journal of Computer Applications. 2017;162(12):5–8. Available from: https://doi.org/10.5120/ijca2017913418
Bharati A, Sharma DM, Bai L, Sangal R, Corra A. Annotating Corpora Guidelines For POS And Chunk. IIIT, Hyderabad: Language Technologies Research Centre. Available from: https://www.sketchengine.eu/wp-content/uploads/posguidelines_indian_languages.pdf
Kak AA, Mehdi N, Lawaye A. What should be and What should not be? Developing a POS tagset for Kashmiri. Interdisciplinary Journal of Linguistics (IJL). 2009;2:185–96.
Lawaye AA, Purkayastha BS. Kashmir Part of Speech Tagger Using CRF. Paripex - Indian Journal Of Research. 2012;3(3):37–38. Available from: http://doi.org/10.15373/22501991/mar2014/11
Lawaye AA, Purkayastha S. Towards Developing a Hierarchical Part of Speech Tagger for Kashmiri: Hybrid Approach. Proceedings of the 2nd National Conference on Advancement in the Era of Multidisciplinary Systems (AEMDS-2013). 2013;p. 187–192. Available from: https://www.researchgate.net/publication/321937581_Towards_Developing_a_Hierarchical_Part_of_Speech_Tagger_for_Kashmiri_Hybrid_Approach
Mustaif I, Bansal K. English to Kashmiri Translation System: Using Example Based Machine Translation. International Journal of Innovative Research in Computer and Communication Engineering. 2015;2015(10):193–194. Available from: https://1library.net/document/y80x1w5q-english-kashmiri-translation-using-example-machine-translation-approach.html
Mustaif I, Bansal K. English to Kashmiri Translation System. International Journal of Advanced Research in Computer Science and Technology. 2015;2015(2):193–194. Available from: http://ijarcst.com/doc/vol3issue2/ver2/mutasif.pdf
Lone NA, Giri KJ, Bashir R. Machine Intelligence for Language Translation from Kashmiri to English. Journal of Information & Knowledge Management. 2022. Available from: https://doi.org/10.1142/S0219649222500745
Thukroo IA, Bashir R. Spoken Language Identification System for Kashmiri and Related Languages Using Mel-Spectrograms and Deep Learning Approach. 2021 7th International Conference on Signal Processing and Communication (ICSC). 2021;p. 250–255. Available from: https://ieeexplore.ieee.org/document/9673212/
Bhat RA, Sharma DM. A hybrid approach to kashmiri shallow parsing. InThe 5th Language and Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics. 2011. Available from: https://www.yumpu.com/en/document/view/12199664/a-hybrid-approach-to-kashmiri-shallow-parsing-iiit-hyderabad
Bhat RA, Bhat SM, Sharma DM. Towards building a Kashmiri treebank: setting up the annotation pipeline. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14). 2014;p. 748–752.
Lone NA, Giri KJ, Bashir R. Issues in Machine Translation—A Case Study of the Kashmiri Language. In: Machine Intelligence and Data Science Applications. (pp. 117-123) Springer Nature Singapore. 2022.
Mir AT, Lawaye AA. Word Sense Disambiguation for Kashmiri Language Using Supervised Machine Learning. Proceedings of the 17th International Conference on Natural Language Processing. 2021;p. 243–245.
Lone NA, Giri KJ, Bashir R, R. Processing Kashmiri Text from a Document Image and Associated Challenges. In: In Proceedings of the 6th International Conference on Advance Computing and Intelligent Engineering 2023. (pp. 449-455) Springer. 2023.
Bashir R, Quadri S. Identification of Kashmiri script in a bilingual document image. 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013). 2013;p. 575–579. Available from: https://doi.org/10.1109/ICIIP.2013.6707658
Kunchukuttan A, Roy S, Patel P, Ladha K, Gupta S, Khapra MM, et al. Experiences in resource generation for machine translation through crowdsourcing. InProceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12). 2012;p. 384–391. Available from: https://aclanthology.org/L12-1127/

Copyright

© 2022 Lone et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)