Interpretación bidireccional del alfabeto dactilológico mediante una mano robótica y una aplicación móvil para la interacción con personas Sordomudas

Abstract

In the world deaf and dumb people communicate with each other through sign language, when interacting with people without this type of disability they have many communication problems either to ask a simple question or in worse cases to report an emergency. Faced with this problem, a system was developed, which provides the advantage of establishing a successful communication between people with hearing disabilities and any other individual or vice versa, this was done through a mobile application in which data is sent in text form to a robotic hand and the same replicate the fingerprint alphabet, in addition a glove containing a group of sensors was implemented, which allowed obtaining the movements of the hand of an adult person with the knowledge of sign language to observe them in the robotic hand, the which will send a text message to the mobile application with what you want to transmit, all with the aim of being viewed within a conference venue or in an educational class. The complete system will consist of a wireless interface that communicates the robotic hand, the glove, and the mobile application to achieve two-way interpretation. The purpose of carrying out this project was to promote and collaborate in the inclusion of people with hearing disabilities both in the social and occupational fields, and that they can freely exercise all their rights without causing inconvenience when communicating.