Implementation of Real-Time Static Hand Gesture Recognition Using Artificial Neural Network

Authors

  • Lita Yusnita President University
  • Rosalina Rosalina President University
  • Rusdianto Roestam
  • R. B. Wahyu President University

DOI:

https://doi.org/10.21512/commit.v11i2.2282

Keywords:

Static Hand Gesture, Artificial Neural Network, Speech Translation, SIBI

Abstract

This paper implements static hand gesture recognition in recognizing the alphabetical sign from “A” to “Z”, number from “0” to “9”, and additional punctuation mark such as “Period”, “Question Mark”, and “Space” in Sistem Isyarat Bahasa Indonesia (SIBI). Hand gestures are obtained by evaluating the contour
representation from image segmentation of the glove wore by user. Then, it is classified using Artificial Neural Network (ANN) based on the training model previously built from 100 images for each gesture. The accuracy rate of hand gesture translation is calculated to be 90%. Moreover, speech translation recognizes NATO phonetic letter as the speech input for translation.

Dimensions

Plum Analytics

Author Biography

Rusdianto Roestam

President University

References

D. R. Kurnia and T. Slamet, “Menormalkan yang dianggap ”tidak normal” (studi kasus: Penertiban bahasa isyarat tunarungu di slb malang),” Indonesian Journal of Disability Studies (IJDS), vol. 3,

no. 1, pp. 34–43, 2016.

N. B. Bhoyar and M. Bartere, “Neural network based static hand gesture recognition,” International Journal of Application or Innovation in Engineering & Management (IJAIEM), vol. 3, no. 2, Feb. 2014.

P. Chaudhary and H. S. Ryait, “Neural network based static sign gesture recognition system,” International Journal of Innovative Research in Computer and Communication Engineering, vol. 2, no. 2, pp. 3066–3072, Feb. 2014.

T. Ahmed, “A neural network based real time hand gesture recognition system,” International journal of computer applications, vol. 59, no. 4, Dec. 2012.

T.-N. Nguyen, H.-H. Huynh, and J. Meunier, “Static hand gesture recognition using artificial neural network,” Journal of Image and Graphics, vol. 1, no. 1, pp. 34–38, Mar. 2013.

C. C. Chang, J. J. Chen, W. K. Tai, and C. C. Han, “New approach for static gesture recognition,” Journal of Information Science and Engineering, vol. 22, no. 5, pp. 1047–1057, 2006.

M. K. Agoston, Computer Graphics and Geometric Modeling. Springer Science & Business Media, 2005, vol. 1.

G. Amir. (2008, Nov.) Rapid application development model (rad model). [Online]. Available: http://www.testingexcellence.

com/rapid-application-development-rad/

R. C. Gonzalez, “Digital image processing: Pearson education india,” 2009.

G. J. Awcock and R. Thomas, Applied Image Processing. McGraw–Hill, Inc., 1995.

R. C. Gonzalez and R. E. Woods, “Digital image processing,” 2002.

M. Alex. (2016, Dec.) Deep learning basics: Neural networkds, backpropagation, and stochastic gradient descent. [Online]. Available: http://alexminnaar.com/deep-learning-basics-neural-networks-backpropagation-and-stochastic-html

H. Zhou, D. J. Lin, and T. S. Huang, “Static hand gesture recognition based on local orientation histogram feature distribution model,” in Proceedings of Computer Vision and Pattern Recognition

Workshop, 2004 (CVPRW’04), vol. 10, IEEE. Washington, DC, USA: IEEE Computer Society, 2004, p. 161.

Downloads

Published

2017-10-31
Abstract 798  .
PDF downloaded 659  .