Modelling of basic Indonesian Sign Language translator based on Raspberry Pi technology
Annotation
Deaf people have hearing loss from mild to very severe. Such people have difficulty processing language information both with and without hearing aids. Deaf people who do not use hearing aids use sign language in their everyday conversations. At the same time, it is difficult for general people to communicate with the deaf, so in order to communicate with the deaf they must know sign language. There are two sign languages in Indonesia, namely SIBI (Indonesian Sign Language System) and BISINDO (Indonesian Sign Language). To help with communication between deaf and normal people, we developed a model using the one-handed SIBI method as an example, and then further developed it using the one-handed and two-handed BISINDO. The main function of the method is the recognition of basic letters, words, sentences and numbers using a Raspberry Pi single-board computer and a camera which are designed to detect the movements of language gestures. With the help of a special program, images are translated into text on the monitor screen. The method used is image processing and machine learning using the Python programming language and Convolutional Neural Network techniques. The device prototype issues a warning to repeat the sign language if the translation fails, and delete the translation if it doesn’t match the database. The prototype of the device requires further development providing its flexibility: to provide reading of dynamic movements, facial expressions, to provide translation of words not included in the existing database. You need to add a database other than SIBI, such as BISINDO, or sign languages from other regions or countries.
Keywords
Постоянный URL
Articles in current issue
- Methods for audiovisual recognition of people in masks
- Influence of the ratio of the intensities of the reference and object waves on the intensity distribution in the holographic field
- High-precision fiber-optic temperature sensor based on Fabry-Perot interferometer with reflective thin-film multilayer structures
- Optical system design method for the concentration of radiation from a high-power LED
- Detection of potholes on road surfaces using photogrammetry and remote sensing methods
- Adaptive control of nonlinear plant with unmatched parametric uncertainties and input saturation
- Application of failure detection methods to detect information attacks on the control system
- DC motor fault detection and isolation scheme with the use of directional residual set
- Synthesis and implementation of λ-approach of slide control in heat-consumption system
- Photocatalytic properties of Ag-AgBr nanostructures in ion-exchanged layers of bromide sodium-zinc-aluminosilicate glass matrix
- Mechanization of pomset languages in the Coq proof assistant for the specification of weak memory models
- Cloud-based intelligent monitoring system to implement mask violation detection and alert simulation
- Efficient incremental hash chain with probabilistic filter-based method to updateblockchain light nodes
- Method for generating masks on face images and systems for their recognition
- Improving sign language processing via few-shot machine learning
- Quantum-probabilistic SVD: complex-valued factorization of matrix data
- A method of multimodal machine sign language translation for natural human-computer interaction
- Web app for quick evaluation of subjective answers using natural language processing
- Substantiation of construction and evaluation ways of the application efficiency for spatially distributed system of information sensors to provide environment monitoring
- Monitoring of infiltration processes in hydraulic structures using distributed acoustic sensing technology
- Slotted waveguide antenna design for maritime radar system