Edit distance-based search approach for retrieving element-wise prosody/rhymes in Hindi-Urdu poetry

Muhammad Yaseen nbsp Khan nbsp    nbsp; nbsp Muhammad Adil nbsp Rao  nbsp; nbsp Shaukat nbsp Wasi; nbsp Twaha Ahmed nbsp Minai; Syed Muhammad Khaliq ur Rahman nbsp Raazi

doi:10.17485/IJST/v13i39.1489

Article

Edit distance-based search approach for retrieving element-wise prosody/rhymes in Hindi-Urdu poetry

VIEWS 2691
PDF 509

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v13i39.1489

Year: 2020, Volume: 13, Issue: 39, Pages: 4189-4201

Original Article

Edit distance-based search approach for retrieving element-wise prosody/rhymes in Hindi-Urdu poetry

Muhammad Yaseen Khan ^1* , Muhammad Adil Rao² , Shaukat Wasi¹ , Twaha Ahmed Minai ² , Syed Muhammad Khaliq-ur-Rahman Raazi ¹

¹ Center for Language Computing, FoC, Mohammad Ali Jinnah University, Karachi, Pakistan
² Department of Computer Science, DHA Suffa University, Karachi, Pakistan

*Corresponding Author
Email: [email protected]

Received Date:25 August 2020, Accepted Date:24 September 2020, Published Date:09 November 2020

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Background: Prosody (rhyming words) is a connatural element of poetry, throughout its reach, across thousands of languages in the world. Since medieval era, the Indic poetry (principally the Hindi/Urdu poetry) has created an impactful flamboyance w.r.t the subjects, styles, and other creative aspects in poetry. Besides the message of heartfelt poetry, we see the Qafiya (i.e., rhyming words) is the core element, without which we may not consider anything Hindi/Urdu poetry but merely a piece of writing; alongside it, Radif (i.e., a phrasal suffix to qafiya) is also considered next to the intrinsic part in Ghazals. In this regard, the contributions of this paper are one–the development of an optimal technique for the prosodic (qafiya) suggestions/retrieval in Hindi/Urdu poetry; and two–the qafiya suggestions based on the attached subsequent radif. Methods: The work in this paper involves usage of a 13.46 M tokens tri-script corpus of poetry. Instead of phonetic value matching, the proposed methodology employs four different Edit Distances (i.e., Levenshtein, Damerau–Levenshtein, Jaro–Winkler, and Hamming distance) as the comparison measures for prosodic suggestions. Findings: The proposed work shows better results in comparison to ‘Qaafiya Dictionary’ powered by rekhta.org. Moreover, w.r.t the inter-metric similarity and running time Jaro–Winkler appears to be the most optimal algorithm for the rhyme suggestion, whereas the Levenshtein distance is the laziest technique. Novelty/Applications: This work benefits researchers of Indic natural language processing for lexical look-ups and analysis of creative literature, especially poetry.

Keywords: Natural language processing, information retrieval, poetry, prosody, Hindi, Urdu

References

WSM. Cakes and ale. Random House. 2010.
Hashmi R. اصنافِ ادب/ Asnaaf-e-Adab. Lahore. Sang-e-Meel Publishers. 1991.
Crowe RJ, Delmore S, Hall WJ. American poetry at mid-century. 1958.
Al-Biruni ARMIA. / Taḥqīq Mā Li-’l-Hind Min Maqūla Maqbūla Fī’l-fiaql Au Mard̲ūla. Dairat Al-Ma’arif Al-Usmaniya, Hyderabad, reprint Beirut. 1030.
Rampuri NUG. بحر الفصاحت/Beher-ul-Fasahat. Munshi Nawal Kishore. 1885.
Grishman R. Computational linguistics: An introduction. Cambridge University Press. 1986.
Büttcher S, Clarke LAC, Cormack GV. Information retrieval: Implementing and evaluating search engines. MIT Press. 2016.
Zhai C, Massung S. Text data management and analysis: a practical introduction to information retrieval and text mining. Association for Computing Machinery and Morgan & Claypool. 2016.
Luong MT, Pham H, Manning CD. Effective approaches to attention-based neural machine translation. arXiv arXiv:1508.04025. 2015.
Khan 1MY, Ahmed T. Pseudo transfer learning by exploiting monolingual corpus: An experiment on roman urdu transliteration. In: International Conference on Intelligent Technologies and Applications. Springer. 2019.
Wen TH, Gasic M, Mrksic N, Su PH, Vandyke D, Young S. Semantically conditioned lstm-based natural language generation for spoken dialogue systems. 2015.
Radford A, Narasimhan K, Salimans T, Sutskever I. Improving language understanding by generative pre-training. 2018.
Allahyari M, Pouriyeh S, Assefi M, Safaei S, Trippe ED, Gutierrez JB, et al. A brief survey of text mining: Classification, clustering and extraction techniques. arXiv. arXiv:1707.02919. 2017.
Kowsari K, Meimandi KJ, Heidarysafa M, Mendu S, Brown D, Brown. Text Classification Algorithms: A Survey. Information. 2019;10(4). Available from: https://dx.doi.org/10.3390/info10040150
Kachru Y. Hindi-urdu. The Major Languages of South Asia, The Middle East and Africa. 2003;p. 52–68.
Sahitya Akademi A History of Urdu literature. SouthAsiaBooks. 1993.
Prakash B. Writing partition: Aesthetics and ideology in Hindi and Urdu literature. Pearson Education India. 2009.
Busch A. Poetry of kings: The classical Hindi literature of Mughal India. Oxford University Press. 2011.
Eberhard DM, Simons GF, Fennig CD. Ethnologue: Languages of Asia. SIL International. 2019.
Khan MY, Nizami MS. Urdu Sentiment Corpus (v1. 0): Linguistic Exploration and Visualization of Labeled Dataset for Urdu Sentiment Analysis. In: International Conference on Information Science and Communication Technology (ICISCT). IEEE. .
Daud A, Khan W, Che D. Urdu language processing: a survey. Artificial Intelligence Review. 2017;47(3):279–311. Available from: https://dx.doi.org/10.1007/s10462-016-9482-x
Everaert C. Tracing the boundaries between Hindi and Urdu: Lost and added in translation between 20th century short stories.
Kuiper K. The Culture of India. Britannica Educational Publishing. 2010.
Basu M. The Rhetoric of Hindutva. Cambridge University Press. 2017.
García AIM. El gramático Pompeyo y el legado sintáctico de Servio. L'antiquité classique. 2013;82:69–90. Available from: https://dx.doi.org/10.3406/antiq.2013.3827
Rao C, Vaid J, Srinivasan N, Chen HC. Orthographic characteristics speed Hindi word naming but slow Urdu naming: evidence from Hindi/Urdu biliterates. Reading and Writing. 2011;24(6):679–695. Available from: https://dx.doi.org/10.1007/s11145-010-9256-9
Nizami MS, Khan MY, Ahmed T. Towards a generic approach for pos-tagwise lexical similarity of languages. In: International Conference on Intelligent Technologies and Applications. Springer. 2019.
Ahmed T, Nizami MS, Khan MY. Discovering lexical similarity through articulatory feature-based phonetic edit distance. 2020.
Taqi AS. رموزِ شاعری / ِRumooz-e-Shairi. Alqamar Enterprises. 2003.
Reinöhl U. Grammaticalization and the rise of configurationality in Indo-Aryan. (Vol. 20) Oxford University Press. 2016.
Cardona G. Indo-aryan languages. In: The Major Languages of South Asia, the Middle East and Africa. (pp. 29-34) Routledge. 2003.
Khansir AA, Mozafari N. The impact of persian language on indian languages. Theory & Practice in Language Studies. 2014;4(11).
Deo A, Kiparsky P. Poetries in contact: Arabic, persian, and urdu. Frontiers of comparative metrics. 2011;p. 147–173.
Chand KK. Urdu Ghazals: An Anthology from 16th to 20th Century. Sterling Publishers Pvt. Ltd. 1995.
Khan M. ‘Pasha’. Urdu readings section: Izāfat. 2008.
Delacy R. Teach Yourself Beginner’s Urdu Script. 2003.
Muhammad A. ‘Iqbal’. بانگِ درا/Baang-e-Dara. (Vol. 1) 1905.
Khalil MAK. Bang-i-dara (the call of the marching bell) translation. Tayyib Printers. 1991.
Khan M. ‘Momin’. کلیاتِ مومن /Kulyat-e-Momin. Majlis-e-Trakkiye Adab, Lahore. 1964.
Mumtaz B, Urooj S, Hussain S, Haq EU. Break index (bi) annotated speech corpus for urdu tts. In: Conference of The Oriental Chapter of International Committee for Coordination and Standardization of Speech Databases and Assessment Techniques (O-COCOSDA). (pp. 22-27) IEEE. 2016.
Urooj S, Mumtaz B, Hussain S. Urdu intonation. Journal of South Asian Linguistics. 2019;10.
Butt M, Jabeen F, Bögel T. Verb cluster internal wh-phrases in urdu: Prosody, syntax and semantics/pragmatics. Linguistic analysis. 2016;40:445–487.
Butt M, Jabeen F, Bögel T. Ambiguity resolution via the syntax-prosody interface: the case of kya ‘what’in urdu/hindi. Prosody in syntactic encoding. Berlin: de Gruyter. 2018.
Jabeen F, Braun B. Production and perception of prosodic cues in narrow & corrective focus in urdu/hindi. 9th International Conference on Speech Prosody. 2018;p. 30–34.
Hussain SS, . National University of Computing and Emerging Sciences –FAST Prosody in urdu poetry - a phonological approach.
FWP, Khaliq AK. FP, Khaliq KA., eds. Urdu Meter: A Practical Handbook. 1987.
Aruuz. Available from: https://aruuz.com/taqti/.com (accessed 2020-08-22)
Rekhta. Available from: https://rekhta.org (accessed 2020-08-22)
Richardson L. Beautiful soup documentation. 2007.
Bookstein A, Kulyukin AV, Raita T. Generalized hamming distance. Information Retrieval. 2002;5(4):353–375.
Levenshtein VI. Binary codes capable of correcting deletions, insertions, and reversals. Soviet physics doklady. 1966;10(8).
Damerau FJ. A technique for computer detection and correction of spelling errors. Communications of the ACM. 1964;7(3):171–176. Available from: https://dx.doi.org/10.1145/363958.363994
Winkler EW. The state of record linkage and current research problems. In: Statistical Research Division, US Census Bureau. 1999.
Manning CD, Raghavan P, Schütze H. Introduction to information retrieval. Cambridge university press. 2008.
Lochtefeld GJ. The Illustrated Encyclopedia of Hinduism. (Vol. 1) The Rosen Publishing Group, Inc. 2001.
Deo AH. The metrical organization of Classical Sanskrit verse. Journal of Linguistics. 2007;43(1):63–114. Available from: https://dx.doi.org/10.1017/s0022226706004452
Rahman A. Hazaron Khawaishen Aisi: The Wonderful World of Urdu Ghazals. 2018.

Copyright

© 2020 Khan et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee).