American Sign Language Translation from Deaf-Mute People Based on Novel System

Batool A. Sahm; Hassanin Al-Fahaam; Abbas A. Jasim

doi:10.5614/j.eng.technol.sci.2024.56.2.2

Authors

Batool A. Sahm
pgs.batool.abdullah@uobasrah.edu.iq
Department of Computer Engineering, College of Engineering, University of Basrah, Al Hartha, Basra 61009, Iraq, Iraq
Hassanin Al-Fahaam Department of Computer Engineering, College of Engineering, University of Basrah, Al Hartha, Basra 61009, Iraq, Iraq
Abbas A. Jasim College of Oil and Gas Engineering, Basrah University for Oil and Gas, Al Quma, Basra 61016, Iraq, Iraq

Vol. 56 No. 2 (2024)

Articles

Published April 30, 2024

Downloads

PDF

Abstract
How to Cite
Metrics
References
License

This paper presents a system to translate gestures from the American Sign Language alphabet using an instrumented wearable glove. This system represents an attempt to utilize a slide potentiometer in sign language translating. The hardware part of the system consists of five slide potentiometers and two force-sensitive resistors, which are best positioned on a glove, based on the analysis of American Sign Language (ASL) letters. In the software part a neural network is used, which was built and trained using Google Colab and Python as the programming language. The performance of the system was tested on three data sets with different numbers of samples. After that, the letters corresponding to the gestures performed are displayed on a computer screen in real time.

Sahm, B. A., Al-Fahaam, H., & Jasim, A. A. (2024). American Sign Language Translation from Deaf-Mute People Based on Novel System. Journal of Engineering and Technological Sciences, 56(2), 193–204. https://doi.org/10.5614/j.eng.technol.sci.2024.56.2.2

Download Citation

LaViola, Jr. & Joseph, J., A Survey of Hand Posture and Gesture Recognition Techniques and Technology, Brown University, United States, 1999.

Abed, A.A., & Rahman, S.A., Python-based Raspberry Pi For Hand Gesture Recognition, International Journal of Computer Applications, 173(4), pp. 18-24, 2017.

Sriram, N. & Nithiyanandham, M., A Hand Gesture Recognition Based Communication System for Silent Speakers, in 2013 International Conference on Human Computer Interactions (ICHCI), IEEE, pp. 1-5, Aug. 2013.

Shukor, A.Z., Miskon, M.F., Jamaluddin, M.H., bin Ali, F., Asyraf, M.F., & bin Bahar, M.B., A New Data Glove Approach for Malaysian Sign Language Detection, Procedia Computer Science, 76, pp. 60-67, 2015.

Rehman, A. & Shoufan, A., A Linguistic Communication Interpretation Wearable Device for Deaf and Mute User, International Journal of Advanced Science Computing and Engineering, 4(2), pp. 121-129, 2022.

Ahmed, M.A., Zaidan, B.B., Zaidan, A.A., Salih, M.M., & Lakulu, M.M.B., A Review on Systems-Based Sensory Gloves for Sign Language Recognition State of the Art between 2007 and 2017, Sensors, 18(7), 2208, 2018.

El Hayek, H., Nacouzi, J., Kassem, A., Hamad, M. & El-Murr, S., Sign to Letter Translator System Using a Hand Glove, in The Third International Conference on e-Technologies and Networks for Development (ICeND2014), IEEE, pp. 146-150, Apr. 2014.

Chouhan, T., Panse, A., Voona, A.K. & Sameer, S.M., Smart Glove with Gesture Recognition Ability for the Hearing and Speech Impaired, in 2014 IEEE Global Humanitarian Technology Conference-South Asia Satellite (GHTC-SAS), IEEE, pp. 105-110, Sep. 2014,

Praveen, N., Karanth, N. & Megha, M.S., Sign Language Interpreter Using a Smart Glove, in 2014 International Conference on Advances in Electronics Computers and Communications, IEEE, pp. 1-5, Oct. 2014.

Abhishek, K.S., Qubeley, L.C.F. & Ho, D., Glove-Based Hand Gesture Recognition Sign Language Translator Using Capacitive Touch Sensor, in 2016 IEEE International Conference on Electron Devices and Solid-State Circuits (EDSSC), IEEE, pp. 334-337, Aug. 2016.

Jaber, H.A., Rashid, M.T. & Fortuna, L., Using the Robust High Density-Surface Electromyography Features for Real-Time Hand Gestures Classification, in IOP Conference Series: Materials Science and Engineering, IOP Publishing, 745(1), 012020, Feb. 2020.

Zhou, Z., Chen, K., Li, X., Zhang, S., Wu, Y., Zhou, Y., Meng, K., Sun, C., He, Q., Fan, W. & Fan, E., Sign-to-Speech Translation Using Machine-Learning-Assisted Stretchable Sensor Arrays, Nature Electronics, 3(9), pp. 571-578, 2020.

Li, L., Jiang, S., Shull, P.B. & Gu, G., SkinGest: Artificial Skin for Gesture Recognition via Filmy Stretchable Strain Sensors, Advanced Robotics, 32(21), pp. 1112-1121, 2018.

Vijayalakshmi, P. & Aarthi, M., Sign Language to Speech Conversion, in 2016 International Conference On Recent Trends In Information Technology (ICRTIT), IEEE, pp. 1-6, Apr. 2016.

Abed, M.H., Wali, W.A. & Alaziz, M., Machine Learning Approach Based on Smart Ball COMSOL Multiphysics Simulation for Pipe Leak Detection, Iraqi Journal for Electrical & Electronic Engineering, 19(1), 2023.

Picton, P., Introduction to Neural Networks, ed. 1, Springer, 1994.

Panchal, G., Ganatra, A., Kosta, Y.P. & Panchal, D., Behaviour Analysis of Multilayer Perceptrons with Multiple Hidden Neurons and Hidden Layers, International Journal of Computer Theory and Engineering, 3(2), pp. 332-337, 2011.

Abed, A.A., Al-Ibadi, A. & Abed, I.A., Real-time Multiple Face Mask and Fever Detection Using Yolov3 and TensorFlow Lite Platforms, Bulletin of Electrical Engineering and Informatics, 12(2), pp. 922-929, 2023.

Grandini, M., Bagli, E. & Visani, G., Metrics for Multi-Class Classification: An Overview, arXiv preprint arXiv:2008.05756, 2020.

Salim, H., Alaziz, M. & Abdalla, T., Human Activity Recognition Using the Human Skeleton Provided by Kinect, Iraqi J. Electr. Electron Eng., 17(2), pp. 183-189, 2021.

Al-Qaysi, Z., Al-Saegh, A., Hussein, A.F. & Ahmed, M., Wavelet-based Hybrid Learning Framework for Motor Imagery Classification, Iraqi J. Electr. Electron Eng., 19(1), pp. 47-56, 2022.