[ Lenguaje de señas por medio de Kinect ]
Volume 29, Issue 1, April 2020, Pages 1–13
Altamirano Sánchez Jesus David1, Flores Martínez Teresita de Jesús2, Sampayo Sebastián Berenice3, and Castillo Quiroz Gregorio4
1 Ingeniería Mecatrónica, Tecnológico Nacional de , Instituto Tecnológico Superior de Huauchinango, Huauchinango, Puebla, Mexico
2 Ingeniería Mecatrónica, Tecnológico Nacional de , Instituto Tecnológico Superior de Huauchinango, Huauchinango, Puebla, Mexico
3 Ingeniería Mecatrónica, Tecnológico Nacional de , Instituto Tecnológico Superior de Huauchinango, Huauchinango, Puebla, Mexico
4 Ingeniería Mecatrónica, Tecnológico Nacional de , Instituto Tecnológico Superior de Huauchinango, Huauchinango, Puebla, Mexico
Original language: Spanish
Copyright © 2020 ISSR Journals. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Currently the sign language is used almost exclusively among deaf people or people around them, the use of signs as a communication system is as old in the history of mankind as that of oral languages. Taking this into account, the sign language research project through Kinect sought to have a social and educational impact, where appropriate didactic software for the translation of sign language was developed and applied. For the fulfillment of the objective a software was developed that allowed the translation of sentences in the sign language to audio for the receiver, because the Kinect Version 2 is in charge of detecting the movements of the image that it has in its visual field, to from different segments of the body's joints and a gray scale scheme of the facial gestures, when detected, vectors are generated in the Cartesian plane where the configured three-dimensional images are processed, and also how it translates the sentences heard by the Kinect to images. Deaf people are often denied education, even in sign language as there is a lack of teachers with good training in sign language. Therefore, this will help to have an educational inclusion and offer the opportunity to support and protect your linguistic identity.
Author Keywords: Language, Programation, Signals.
Volume 29, Issue 1, April 2020, Pages 1–13
Altamirano Sánchez Jesus David1, Flores Martínez Teresita de Jesús2, Sampayo Sebastián Berenice3, and Castillo Quiroz Gregorio4
1 Ingeniería Mecatrónica, Tecnológico Nacional de , Instituto Tecnológico Superior de Huauchinango, Huauchinango, Puebla, Mexico
2 Ingeniería Mecatrónica, Tecnológico Nacional de , Instituto Tecnológico Superior de Huauchinango, Huauchinango, Puebla, Mexico
3 Ingeniería Mecatrónica, Tecnológico Nacional de , Instituto Tecnológico Superior de Huauchinango, Huauchinango, Puebla, Mexico
4 Ingeniería Mecatrónica, Tecnológico Nacional de , Instituto Tecnológico Superior de Huauchinango, Huauchinango, Puebla, Mexico
Original language: Spanish
Copyright © 2020 ISSR Journals. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract
Currently the sign language is used almost exclusively among deaf people or people around them, the use of signs as a communication system is as old in the history of mankind as that of oral languages. Taking this into account, the sign language research project through Kinect sought to have a social and educational impact, where appropriate didactic software for the translation of sign language was developed and applied. For the fulfillment of the objective a software was developed that allowed the translation of sentences in the sign language to audio for the receiver, because the Kinect Version 2 is in charge of detecting the movements of the image that it has in its visual field, to from different segments of the body's joints and a gray scale scheme of the facial gestures, when detected, vectors are generated in the Cartesian plane where the configured three-dimensional images are processed, and also how it translates the sentences heard by the Kinect to images. Deaf people are often denied education, even in sign language as there is a lack of teachers with good training in sign language. Therefore, this will help to have an educational inclusion and offer the opportunity to support and protect your linguistic identity.
Author Keywords: Language, Programation, Signals.
Abstract: (spanish)
Actualmente el lenguaje de señas se utiliza casi exclusivamente entre personas sordas o personas del entorno de dichas personas, el uso de las señas como sistema de comunicación es tan antiguo en la historia de la humanidad como el de las lenguas orales. Tomando en cuenta esto, el proyecto de investigación Lenguaje de señas por medio de Kinect busco tener un impacto social y educativo, en donde se desarrolló y aplico un software didáctico adecuado para la traducción del lenguaje de señas. Para el cumplimiento del objetivo se desarrolló un software que permitió la traducción de oraciones en el lenguaje de señas a audio para el receptor, debido a que el Kinect Versión 2 se encarga de detectar los movimientos de la imagen que tiene en su campo visual, a partir de diferentes segmentos de las articulaciones del cuerpo y un esquema en escala de grises de los gestos del rostro, al detectarse se generan vectores en el plano cartesiano donde se procesan las imágenes tridimensionales configuradas, y así mismo como traduce las oraciones escuchadas por el Kinect a imágenes. A las personas sordas a menudo se les niega la educación, incluso en lengua de señas ya que existe una carencia de profesores con una buena formación en el lenguaje de señas. Por ello esto ayudara a tener una inclusión educativa y ofrecer la oportunidad de apoyar y proteger su identidad lingüística.
Author Keywords: Lenguaje, Programación, Señales.
How to Cite this Article
Altamirano Sánchez Jesus David, Flores Martínez Teresita de Jesús, Sampayo Sebastián Berenice, and Castillo Quiroz Gregorio, “Sign language through Kinect,” International Journal of Innovation and Applied Studies, vol. 29, no. 1, pp. 1–13, April 2020.
