Toward Normalizing Romanized Gurumukhi Text from Social Media

Jagroop Kaur and Jaswinder Singh

doi:10.17485/ijst/2015/v8i27/81666

Article

Toward Normalizing Romanized Gurumukhi Text from Social Media

VIEWS 916
PDF 805

Abstract
Full-Text HTML
Full-Text PDF
How to Cite

Indian Journal of Science and Technology

DOI: 10.17485/ijst/2015/v8i27/81666

Year: 2015, Volume: 8, Issue: 27, Pages: 1-6

Original Article

Toward Normalizing Romanized Gurumukhi Text from Social Media

Jagroop Kaur and Jaswinder Singh^*

Department of Computer Engineering, Punjabi University, Patiala - 147002, Punjab, India; [email protected]

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Roman characters are used to write Indian language text on social media like facebook and twitter. Processing this text for NLP applications is not a trivial task. This text needs to be transliterated as well as conversion to canonical form. This paper discusses the various issues involved in normalizing such text in the domain of Punjabi Language. An algorithm is proposed to normalize Punjabi language text which is written using roman script. The proposed algorithm tries to find out all possible combinations and then filter using n-gram language model.
Keywords: Text Normalization, Transliteration, Social Media Text