AUTOMATED HANDDETECTION METHOD FOR TASKS OF GESTURE RECOGNITION IN HUMAN-MACHINE INTERFACES
Annotation
Subject of Research. The paper presents a solution for automatic analysis and recognition of human hand gestures. Recognition of the elements of sign languages is a topical task in the modern information world. The problem of gesture recognition efficiency has not been resolved due to the presence of cultural diversities in the world sign languages, the differences in the conditions for showing gestures. The problem becomes more complicated by the small size of fingers. Method. The presented method is based on the analysis of frame sequences of a video stream obtained using an optical camera. For processing of the obtained video sequences, it is proposed to use a depth map and a combination of modern classifiers based on Single Shot MultiBox Detector deep neural network architectures with a reduced network model of ResNet-10, NASNetMobile and LSTM type. Main Results. Experiments on automatic video analysis of hand movements and gesture recognition in real time show great potential of the proposed method for human-machine interaction tasks. The recognition accuracy of 48 one-handed gestures based on TheRuSLan database is 79 %. This result is better as compared to the other approaches to solving this problem. Practical Relevance. The results can be used in automatic systems for recognition of sign languages, as well as in the situations where contactless interaction of various user groups is necessary, for example, people with hearing and vision impairments, mobile information robots through automatic recognition of sign information.
Keywords
Постоянный URL
Articles in current issue
- READER’S NOTE
- BLOCKCHAIN TECHNOLOGY IN 5G NETWORKS
- LASER HEATING NUMERICAL SIMULATION OF TITANIUM-CONTAINING OPTOTHERMAL FIBER CONVERTER AND VEIN WALL DURING ENDOVASALLASER COAGULATION
- EXPERIMENTAL STUDY OF OPTICAL POWER EFFECT ON THE STRUCTURE OF FIBER-OPTICAL DIFFUSER OBTAINED BY FIBER CORE MELTING
- METHODS OF HOT WIRE CREATION FOR FIBER-OPTICAL THERMAL ANEMOMETER
- EFFECT OF EXTERNAL RELATIVE PRESSURE ON PHASE SHIFT IN SAGNAC INTERFEROMETER
- ABSORPTION CHARACTERISTICS OF SILVER ION-EXCHANGED LAYERS IN CHLORIDE PHOTO-THERMO-REFRACTIVE GLASS
- ERBIUM SPECTRAL-LUMINESCENT CHARACTERISTICS IN BROMIDE-FLUORIDE PHOTO-THERMO-REFRACTIVE GLASSES
- AUTOMATED HANDDETECTION METHOD FOR TASKS OF GESTURE RECOGNITION IN HUMAN-MACHINE INTERFACES
- MODERN APPROACHES TO MULTICLASS INTENT CLASSIFICATION BASED ON PRE-TRAINED TRANSFORMERS
- EFFECTIVE IMPLEMENTATION OF MODERN MCELIECE CRYPTOSYSTEM ON GENERALIZED (L,G)-CODES
- NORMALIZATION OF KAZAKH LANGUAGE WORDS
- IMAGE-BASED DEFECT ANALYSIS FOR 3D-PRINTED ITEM SURFACE USING MACHINE LEARNING METHODS
- MODEL OF AUTOMATED SYNTHESIS TOOL FOR HARDWARE ACCELERATORS OF CONVOLUTIONAL NEURAL NETWORKS FORPROGRAMMABLE LOGIC DEVICES
- PACKET RESERVATIONS IN REAL-TIME MULTIPATH TRANSMISSIONS
- MODULAR APPROACH APPLICATION IN DEVELOPMENT OF COMPUTER NUMERICAL CONTROL SOFTWARE
- PARAMETRIC IDENTIFICATION OF DIFFERENTIAL-DIFFERENCE MODELS OF HEAT TRANSFER IN ONE-DIMENSIONAL BODIES BASED ON KALMAN FILTER ALGORITHMS
- SELECTION OF COMPOSITE MATERIAL IN ELECTROMAGNETIC LOG SENSOR
- MODELING OF LIQUEFIED NATURAL GAS EVAPORATION IN MOBILE RESERVOIRS
- MATHEMATICAL MODEL OF LIQUEFIED NATURAL GAS EVAPORATION AND ANALYSIS OF ORIGINAL COMPOSITION EFFECT ON EVAPORATION SPEED
- MESHLESS MODELING OF ELASTIC DEFORMATIONS OF POLYMERIC COMPOSITE MATERIALS UNDER STATIC LOADING
ACCURACY INCREASE OF SOFTWARE AND HARDWARE APPLIANCE FOR MUSCLE ACTIVITY MEASURING AND MONITORING BY FILTRATION OF CARRIER COMPONENT AND FREQUENCIES HIGHER THAN MEASURED SIGNAL RANGE