![Scientific and Technical Journal of Information Technologies, Mechanics and Optics](/images/mag-ntv.png)
VISUAL CONCEPT LEARNING SYSTEM BASED ON LEXICAL ELEMENTS AND FEATURE KEY POINTS CONJUNCTION
![Scientific and Technical Journal of Information Technologies, Mechanics and Optics](/images/mag-ntv.png)
Annotation
Subject of Research. The paper deals withthe process of visual concept building based on two unlabeled sources of information (visual and textual). Method. Visual concept-based learning is carried out with image patterns and lexical elements simultaneous conjunction. Concept-based learning consists of two basic stages: early learning acquisition (primary learning) and lexical-semantic learning (secondary learning). In early learning acquisition stage the visual concept dictionary is created providing background for the next stage. The lexical-semantic learning makes two sources timeline analysis and extracts features in both information channels. Feature vectors are formed by extraction of separated information units in both channels. Mutual information between two sources describes visual concepts building criteria. Main Results. Visual concept-based learning system has been developed; it uses video data with subtitles. The results of research have shown principal ability of visual concepts building by our system. Practical Relevance.Recommended application area of described system is an object detection, image retrieval and automatic building of visual concept-based data tasks.
Keywords
Постоянный URL
Articles in current issue
- STATE-OF-THE-ART TASKS AND ACHIEVEMENTS OF PARALINGUISTIC SPEECH ANALYSIS SYSTEMS
- HIGH-STABLE ERBIUM SUPERLUMINESCENT FIBER OPTICAL SOURCES CREATION METHODS
- ANALYSIS OF PULSE OPTICAL TARGET SEEKER STATIC CHARACTERISTICS AT TARGET AIRCRAFTS EXPOSURE
- INFLUENCE OF SURFACE TREATMENT AND PURIFICATION METHODS OF CO-115M GLASS-CERAMICS ON OPTICAL CONTACT STRENGTH
- ROBUST ALGORITHMS OF PARAMETRIC ESTIMATION IN SOME STABILIZATION PROBLEMS
- INTERVAL STATE ESTIMATION FOR SINGULAR DIFFERENTIAL EQUATION SYSTEMS WITH DELAYS
- USAGE OF PRESSURE OSCILLATIONS OF FLUCTUATING GAS FLOW FOR HANDLING OF 40X HARDENED STEEL SAMPLES
- SYNTHESIS, STRUCTURE AND SPECTRAL PROPERTIES OF POTASSIUMALUMINA- BORATE GLASS WITH NANOCRYSTALS OF MANGANESE FERRITE
- EVALUATION CRITERIA AND MODELS OF INFORMATION SYSTEMS WITH THE PROPERTY OF BEHAVIOR
- DYNAMIC SOFTWARE TESTING MODELS WITH PROBABILISTIC PARAMETERS FOR FAULT DETECTION AND ERLANG DISTRIBUTION FOR FAULT RESOLUTION DURATION
- DISTANCE MEASUREMENT BASED ON A SINGLE DEFOCUSED PHOTOGRAPH
- APPLICATION OF BINARY DESCRIPTORS TO MULTIPLE FACE TRACKING IN VIDEO SURVEILLANCE SYSTEMS
- PRECISION, SPEED AND COMPLEXITY OF DEVICES FOR IMAGE CODING BY CONTROL POINTS
- IMPLEMENTATION OF SIDE-CHANNEL LEAKAGE DETECTION TECHNIQUE BASED ON NORMALIZED INTER-CLASS VARIANCE METHOD
- DEVELOPMENT OF AUTOMATED SPEECH RECOGNITION SYSTEM FOR EGYPTIAN ARABIC PHONE CONVERSATIONS
- SVC VIDEO STREAM ALLOCATION AND ADAPTATION IN HETEROGENEOUS NETWORK
- MOLECULAR DYNAMICS SIMULATION OF LYSINE DENDRIMER AND SEMAX PEPTIDES INTERACTION
- CURRENT-VOLTAGE CHARACTERISTICS FOR TWO SYSTEMS OF QUANTUM WAVEGUIDES WITH CONNECTED QUANTUM RESONATORS
- MODEL STUDY OF THE DOUBLE FED MACHINE WITH CURRENT CONTROL
- COMPUTER SIMULATION OF ELECTROMAGNETIC LOG SENSOR STRENGTH CHARACTERISTICS
- STUDY OF STRONG CONFINEMENT OF CADMIUM SELENIDE QUANTUM DOTS IN FLUORINE-PHOSPHATE GLASSES
- TECHNICAL VISION SYSTEM FOR THE ROBOTIC MODEL OF SURFACE VESSEL
- STUDY OF SILVER CHLORIDE NANOCRYSTALS GROWTH IN FLUORINE PHOSPHATE GLASS