Total views : 839

Electronic Travel Aid for Visually Impaired People based on Computer Vision and Sensor Nodes using Raspberry Pi

Affiliations

  • ECE Department, Lovely Professional University, Phagwara - 144411, Punjab, India

Abstract


Objectives: To make robust, reliable and affordable Electronic Travel Aid (ETA) which is composed of ultrasonic sensor nodes, smart cane stick and object detection device used in synergy used by blind and visually impaired persons for navigation and object recognition in indoor and outdoor environments. Methods: For the navigation in indoor environment, four ultrasonic sensor nodes which measure proximity of surrounding obstacles and if any object is too close then vibration feedback is given to the user. Smart cane stick will detect wet floor and stairs and if detected then vibration feedback is given at cane handle. In object recognition device we have used Raspberry pi 3 and camera which will detect defined objects in front of the blind user and describe it using audio feedback via headphones in which we have used computer vision techniques from opencv libraries like SURF extraction and haar cascades used with neural networks for cognitive machine learning which makes object detection and recognition robust. Findings: Using ultrasonic sensor nodes at ankles, wrist and waist, yielded better navigation in indoor environment because the ultrasonic sensors are more accurate, fast and distortion less as compared to the other sensors. A simple cane stick gives less information about the environment while smart cane stick gives information about stairs, wet floor and unevenness of floor to the blind user to avoid collision and also better range of detection as compared to simple cane stick. For object recognition, SURF feature extraction and haar cascades are used which is best suited for object detection and recognition of defined objects. And using machine learning increases the accuracy of the object recognition for unknown objects so like this the blind user can understand what kind of object is there infront of him, which was not possible using distance sensors alone. Using the three devices in synergy the blind person can navigate and recognize the objects in indoor and outdoor environments more easily and makes our ETA more accurate, efficient and affordable. Application: For visualisation of the surroundings for blind and visually impaired people.

Keywords

Computer Vision,Electronic Travel Aid, Haar Cascades, Object Detection and Recognition, OpenCV, Raspberry Pi, Smart Cane Stick, SURF.

Full Text:

 |  (PDF views: 199)

References


  • Visual impairment and blindness[Internet]. [cited 2016 Jul 15]. Available from: http://www.who.int/mediacentre/factsheets/ fs282/en/.
  • Gao Y, Kwok K-W, Chandrawanshiv R, Squires A, Nau AC, Tsz Z, Tse H. Wearable virtual white cane: assistive technology for navigating the visually impaired. Journal of Medical Devices. 2014 Mar 03, Paper No: MED-14-1062.
  • Bhatlawande S, Mahadevappa M, Mukherjee J, Biswas M, Das D, Gupta S. Design, development, and clinical evaluation of the electronic mobility cane for vision rehabilitation. IEEE Transactions on Neural Systems and Rehabilitation Engineering;2014 19 May. p.1148–59.
  • Lu Y, Huang J, Xu W, Tao C, Wang X. An electronic travel aid based on multi-sensor fusion using extended Kalman filter. 2014 11th World Congress on Intelligent Control and Automation (WCICA),. 2015 Mar 05.DOI: 10.1109/WCICA. 2014.7052681
  • Varde S, Panse MS. Computer vision based travel aid for blind. International Journal of Latest Technology in Engineering, Management & Applied Science. 2015 Aug; IV(VIII):1.
  • Chincha R, Tian YL. Finding objects for blind people based on SURF features. 2011 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW). 2011 Dec 27.DOI: 10.1109/BIBMW.2011.6112423.

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.