Indian Journal of Science and Technology
Year: 2022, Volume: 15, Issue: 43, Pages: 2325-2335
J Vaishnavi1*, V Narmatha2
1Research scholar, Department of Computer & Information science, Annamalai University, Annamalai Nagar, Tamil Nadu, India
2Assiatant Professor, Department of Computer & Information science, Annamalai University, Annamalai Nagar, Tamil Nadu, India
Email: [email protected]
Received Date:13 September 2022, Accepted Date:08 October 2022, Published Date:17 November 2022
Objectives: To generate the captions for the videos with less time complexity and high accuracy and also to create captions for each input video frame with particular timestamps. It will be utilized in the crime branch and hearingimpaired people will learn about the happenings of the video fruitfully. Methods: The proposed approach experiments with Transfer learning techniques. Modified Inception v3 and Resnet 50 networks are designed to compare the results. The standard MSVD Dataset is utilized to demonstrate the architectures. The performances are compared with the standard performance metrics. Findings: The inception v3 model works better than the Resnet 50 architecture for video captioning tasks. It provides the best accuracy at 99.83% with captions for the given input videos than Resnet 50 model. The MSVD dataset is more suitable for the demonstration of the video captioning task. Novelty: The two proposed models are modified based on the working of the video captioning tasks. The aggregation of some layers boosts the performance of the models more than ordinary models.
Keywords: Artificial Intelligence; Automatic Captioning; Transfer Learning; Frames; Inception V3; Residual Network50 Model
© 2022 Vaishnavi & Narmatha. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)
Subscribe now for latest articles and news.