Recognition of Tablet using Blister Strip for Visually Impaired using SIFT Algorithm

R Shashidhar; V Sahana; Sudeshna Chakraborty; S B Puneeth; M Roopa

doi:10.17485/IJST/v14i23.750

Article

Recognition of Tablet using Blister Strip for Visually Impaired using SIFT Algorithm

VIEWS 1600
PDF 937

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v14i23.750

Year: 2021, Volume: 14, Issue: 23, Pages: 1953-1960

Original Article

Recognition of Tablet using Blister Strip for Visually Impaired using SIFT Algorithm

R Shashidhar ^1,*, V Sahana ², Sudeshna Chakraborty ³, S B Puneeth ⁴, M Roopa ⁵

1 Assistant Professor, Department of Electronics and Communication Engineering, JSS Science and Technology University, Sri Jayachamarajendra College of Engineering, Mysuru, India

2 Assistant Professor, Department of Information Science and Engineering, JSS Academy of Technical Education, Bengaluru, India

3 Associate Professor, Department of Computer Science and Engineering, School of Engineering and Technology, Sharda University, Greater Noida, Uttar Pradesh, India

4 Assistant Professor, Department of Electronics and Communication Engineering, Presidency University, Bengaluru, India

5 Professor, Department of Electronics and Communication Engineering, Dayananda Sagar College of Engineering, Bengaluru, India

*Corresponding author email: [email protected]

Received Date:07 May 2021, Accepted Date:19 June 2021, Published Date:09 July 2021

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Objectives: To create a tablet recognition system that recognizes and gives an audio output of the name of the tablet so that the visually impaired person may recognize it. Methods: In this, to create a user friendly system, such that a blind person does not require the help of another person to use it. These systems give medical assistive instrument to take the drug at the accurate time as per the doctor prescription and removes dependency on others for the visually challenged people. Various models were technologically advanced to compact with misidentification of remedies but are incompetent of formative exact pill picked by the person. Findings: The name of the medicine is obtained from the image. Then the name of the medicine is converted from text to speech using Google text to speech (gTTS). The proposed system will be helpful for visually challenged people, SQLite Database management system has been used along with Scale Invariant Feature Transform algorithm (SIFT) to identify and pronounce local features in the image. The image of the medicine given by the user is matched with the images in the database. Novelty: Developed a user-friendly voice based tablet recognition system for visually impaired people and this system is fast and accurate.

Keywords

SIFT algorithm, medicine identification, visually impaired people, gTTS, Tablet Recognition

References

Suntronsuk S, Ratanotayanon S. Pill image binarization for detecting text imprints. 13th International Joint Conference on Computer Science and Software Engineering (JCSSE). 2016;p. 1–6. Available from: 10.1109/JCSSE.2016.7748859
GB, TP., eds. Pill Detection & Prescription Analysis. 2019.
Proma TP, Hossan MZ, Amin MA. Medicine Recognition from Colors and Text. In: Proceedings of the 2019 3rd International Conference on Graphics and Signal Processing (ICGSP '19). (pp. 39-43) Association for Computing Machinery. 2019.
Zanjal SV, Talmale GR. Medicine Reminder and Monitoring System for Secure Health Using IOT. Procedia Computer Science. 2016;78:471–476. Available from: https://dx.doi.org/10.1016/j.procs.2016.02.090
Chang WJ, Chen LB, Hsu CH, Lin CP, Yang TC. A Deep Learning-Based Intelligent Medicine Recognition System for Chronic Patients. IEEE Access. 2019;7:44441–44458. Available from: https://dx.doi.org/10.1109/access.2019.2908843
Hsu WJCYXYJHCZYZSJKTHYCH, Chen LB, Chen MC. A Deep Learning Based Wearable Medicines Recognition System for Visually Impaired People. 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS). 2019;p. 207–208.
JY, ZC, SiK, Yang J. Accurate system for automatic pill recognition using imprint information. IET Image Processing. 2015;9. Available from: 10.1049/iet-ipr.2014.1007
Huynh TH, Nguyen TS. A new imprinted tablet recognition algorithm using polar transform and neural networks. 2015 International Conference on Advanced Technologies for Communications (ATC). 2015;p. 38–43. Available from: 10.1109/ATC.2015.7388356
Kang S, Jang GJ, Lee M. Lighting Variability Correction for Pill Identification. 2018 IEEE International Conference on Consumer Electronics - Asia (ICCE-Asia). 2018;p. 206–212. Available from: 10.1109/ICCE-ASIA.2018.8552143
Ou YY, Tsai AC, Wang JF, Lin J. Automatic Drug Pills Detection based on Convolution Neural Network. 2018 International Conference on Orange Technologies (ICOT). 2018;p. 1–4. Available from: 10.1109/ICOT.2018.8705849
Siroratt, Suntronsuk S, Ratanotayanon. Automatic text imprint analysis from pill images. In: 9th International Conference on Knowledge and Smart Technology (KST). (pp. 288-293) 2017. 10.1109/KST.2017.7886081
Wang Y, Ribera J, Liu C, Yarlagadda S, Zhu F. Pill Recognition Using Minimal Labeled Data. In: IEEE Third International Conference on Multimedia Big Data (BigMM). (pp. 346-353) 2017. 10.1109/BigMM.2017.61
Mate GS, Godambe H, Maske M, Gomare A. Visual Product Identification for Blind People. International Journal of Advanced Science and Technology. 2020;29(9s):7538–7543.
Tsai HL, Tseng CH, Wang LC, Juang FS. Bidirectional smart pill box monitored through internet and receiving reminding message from remote relatives. In: 2017 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW). (pp. 393-394) 2017. 10.1109/ICCE-China.2017.7991161
Najeeb 1PNJ, Rimna A, Safa K, Silvana M, Adarsh T. Pill Care-The Smart Pill Box with Remind, Authenticate and Confirmation Function. In: Conference on Emerging Trends and Innovations In Engineering And Tech- nological Research (ICETIETR). (pp. 1-5) 2018. 10.1109/ICETI- ETR.2018.8529030
Lee S, Jung S, Song H. CNN-Based Drug Recognition and Braille Embosser System for the Blind. Journal of Computing Science and Engineering. 2018;12(4):149–156. Available from: https://dx.doi.org/10.5626/jcse.2018.12.4.149
Zhang M, Cao K, Zeng X. Deep learning system for recognizing pills in images. 2018. Available from: https://patents.google.com/patent/US10713540B2/en
Chang WJ, Chen LB, Hsu CH, Chen JH, Yang TC, Lin CP. MedGlasses: A Wearable Smart-Glasses-Based Drug Pill Recognition System Using Deep Learning for Visually Impaired Chronic Patients. IEEE Access. 2020;8:17013–17024. Available from: https://dx.doi.org/10.1109/access.2020.2967400
Kesh S, Ananthanagu U. Text Recognition and Medicine Identification by Visually Impaired People. International Journal Of Engineering Research & Technology (IJERT) ICPCN - 2017. 2017;5.
Mateus A, Neto V, Jo˜ao WM, Souza PPD, Filho R, De AW, et al. CoforDes: An Invariant Feature Extractor for the Drug Pill Identification. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS). 2018;p. 30–35. Available from: 10.1109/CBMS.2018.00013.
Palenychka R, Lakhssassi A, Palenychka M. Verification of Medication Dispensing Using the Attentive Computer Vision Approach. 2018 IEEE International Symposium on Circuits and Systems (ISCAS). 2018;p. 1–4. Available from: 10.1109/ISCAS.2018.8351202
Shashidhar R, Abhilash S, Sahana V, Alok NA, Roopa M. Iot cloud: In health monitoring system. International Journal of Scientific and Technology Research. 2020;9(1).
Ou YY, Tsai AC, Zhou XP, Wang JF. Automatic drug pills detection. IET Computer. 2020(1):9–17.

Copyright

© 2021 Shashidhar et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)