Text Summarization in Assamese Language using Sequence to Sequence RNNs

Pritom Jyoti Goutom; Nomi Baruah

doi:10.17485/IJST/v16iSP2.5429

Article

Text Summarization in Assamese Language using Sequence to Sequence RNNs

VIEWS 295
PDF 70

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v16iSP2.5429

Year: 2023, Volume: 16, Issue: Special Issue 2, Pages: 22-29

Original Article

Text Summarization in Assamese Language using Sequence to Sequence RNNs

Pritom Jyoti Goutom^1*, Nomi Baruah²

¹Center for computer Science and Application, Dibrugarh University, Dibrugarh, Assam, India
²Department of Computer Science and Engineering, DUIET, Dibrugarh University, Dibrugarh, Assam, India

*Corresponding Author
Email: [email protected]

Received Date:23 March 2023, Accepted Date:26 June 2023, Published Date:02 November 2023

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

This study discusses an approach for abstractive text summarization in the Assamese language. Objective: The main objective of this paper is to develop a novel approach for abstractive text summarization in Assamese that efficiently condenses large information while keeping its core meaning. Methods: We utilise a sequence-to-sequence Recurrent Neural Network [RNN] model with an encoder-decoder architecture in this paper. In this study, we use a Bi-LSTM on the encoder side, an attention mechanism, a softmax layer on the decoder side, and Assamese news items obtained from renowned daily newspapers in Assam. Findings: The results show that the suggested model is effective, with a train loss of 0.008 and assessment scores based on ROUGE-1, ROUGE-2, and ROUGE-L criteria. Novelty: The novelty lies in filling the aforementioned gap by proposing and implementing an abstractive text summarization approach for the Assamese language. Improve Assamese text summarization approaches by applying the presented strategy to news items.

Keywords: Abstractive, NLP, RNN, Seq2Seq, Text summarization

References

Abate J, Tulu A. Development of a Query-Based Document Summarization for Afaan Oromoo. Available from: https://gu-clasp.github.io/resourceful-2020/papers/RESOURCEFUL-2020_paper_1.pdf
Jain R. Automatic Text Summarization of Hindi Text Using Extractive Approach. ECS Transactions. 2022;107(1). Available from: https://doi.org/10.1149/10701.4469ecst
Moirangthem DS, Lee M. Abstractive summarization of long texts by representing multiple compositionalities with temporal hierarchical pointer generator network. Neural Networks. 2020;124:1–11. Available from: https://doi.org/10.1016/j.neunet.2019.12.022
Baruah R, Mundotiya RK, Singh AK. Low Resource Neural Machine Translation: Assamese to/from Other Indo-Aryan (Indic) Languages. ACM Transactions on Asian and Low-Resource Language Information Processing. 2021;21(1):1–32. Available from: https://doi.org/10.1145/3469721
Varade S, Sayyed E, Nagtode V, Shinde S. Text Summarization using Extractive and Abstractive Methods. ITM Web of Conferences. 2021;40:1–5. Available from: https://doi.org/10.1051/itmconf/20214003023
Bahare RS, Ganguly S, Choowongkomon K, Seetaha S, . Synthesis, HIV-1 RT inhibitory, antibacterial, antifungal and binding mode studies of some novel N-substituted 5-benzylidine-2, 4-thiazolidinediones. DARU Journal of Pharmaceutical Sciences. 2015;23(6):1–15. Available from: https://doi.org/10.1186/s40199-014-0086-1
Bahdanau D, Cho K, Bengio Y. Neural Machine Translation by Jointly Learning to Align and Translate. 2014. Available from: https://arxiv.org/abs/1409.0473
Yang Z, Liu G. Hierarchical Sequence-to-Sequence Model for Multi-Label Text Classification. IEEE Access. 2019;7:153012–153020. Available from: https://doi.org/10.1109/access.2019.2948855
Uteshov Y. Automatic Text Summarization Using Sequence-To-Sequence Models. Internauka. 2022;19(242). Available from: https://doi.org/10.32743/26870142.2022.19.242.339376
Babu GLA, Badugu S. Deep learning based sequence to sequence model for abstractive telugu text summarization. Multimedia Tools and Applications. 2023;82:17075–17096. Available from: https://doi.org/10.1007/s11042-022-14099-x
Liu PJ, Saleh M, Pot E, Goodrich B, Sepassi R, Kaiser L, et al. Generating Wikipedia by Summarizing Long Sequences. 2018. Available from: https://arxiv.org/abs/1801.10198
Uddin MN, Khan SA. A study on text summarization techniques and implement few of them for Bangla language. In: 2007 10th international conference on computer and information technology. Dhaka, Bangladesh, 27-29 December 2007. IEEE. .
Nath P, Adhikary PK, Dadure P, Pakray P, Manna R, Bandyopadhyay S. Image Caption Generation for Low-Resource Assamese Language. In: The 34th Conference on Computational Linguistics and Speech Processing (ROCLING 2022). Taipei, Taiwan, November 21-22, 2022. p. 263–272.
Baruah R, Mundotiya RK, Singh AK. Low Resource Neural Machine Translation: Assamese to/from Other Indo-Aryan (Indic) Languages. ACM Transactions on Asian and Low-Resource Language Information Processing. 2021;21(1):1–32. Available from: https://doi.org/10.1145/3469721
Talukder MAI, Abujar S, Masum AKM, Faisal F, Hossain SA. Bengali abstractive text summarization using sequence to sequence RNNs. In: 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT). Kanpur, India, 06-08 July 2019. IEEE. .
Yang J, You J, Wan X. Graph Embedding via Graph Summarization. IEEE Access. 2021;9:45163–45174. Available from: https://doi.org/10.1109/access.2021.3067901
Cho K, Merrienboer BV, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, et al. Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation. Association for Computational Linguistics. 2014. Available from: https://arxiv.org/pdf/1406.1078.pdf
Goutom PJ, Baruah N, Sonowal P. An abstractive text summarization using deep learning in Assamese. International Journal of Information Technology. 2023;15:2365–2372. Available from: https://link.springer.com/article/10.1007/s41870-023-01279-7
Chowdhury RR, Nayeem MT, Mim TT, Chowdhury MSR, Jannat T. Unsupervised Abstractive Summarization of Bengali Text Documents. 2021. Available from: https://arxiv.org/pdf/2102.04490.pdf

Copyright

© 2023 Goutom & Baruah. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)