![Scientific and Technical Journal of Information Technologies, Mechanics and Optics](/images/mag-ntv.png)
STATE-OF-THE-ART TASKS AND ACHIEVEMENTS OF PARALINGUISTIC SPEECH ANALYSIS SYSTEMS
![Scientific and Technical Journal of Information Technologies, Mechanics and Optics](/images/mag-ntv.png)
Annotation
We present analytical survey of state-of-the-art actual tasks in the area of computational paralinguistics, as well as the recent achievements of automatic systems for paralinguistic analysis of conversational speech. Paralinguistics studies non-verbal aspects of human communication and speech such as: natural emotions, accents, psycho-physiological states, pronunciation features, speaker’s voice parameters, etc. We describe architecture of a baseline computer system for acoustical paralinguistic analysis, its main components and useful speech processing methods. We present some information on an International contest called Computational Paralinguistics Challenge (ComParE), which is held each year since 2009 in the framework of the International conference INTERSPEECH organized by the International Speech Communication Association. We present sub-challenges (tasks) that were proposed at the ComParE Challenges in 2009-2016, and analyze winning computer systems for each sub-challenge and obtained results. The last completed ComParE-2015 Challenge was organized in September 2015 in Germany and proposed 3 sub-challenges: 1) Degree of Nativeness (DN) sub-challenge, determination of nativeness degree of speakers based on acoustics; 2) Parkinson's Condition (PC) sub-challenge, recognition of a degree of Parkinson’s condition based on speech analysis; 3) Eating Condition (EC) sub-challenge, determination of the eating condition state during speaking or a dialogue, and classification of consumed food type (one of seven classes of food) by the speaker. In the last sub-challenge (EC), the winner was a joint Turkish-Russian team consisting of the authors of the given paper. We have developed the most efficient computer-based system for detection and classification of the corresponding (EC) acoustical paralinguistic events. The paper deals with the architecture of this system, its main modules and methods, as well as the description of used training and evaluation audio data and the best obtained results on machine classification of these acoustic paralinguistic events.
Keywords
Постоянный URL
Articles in current issue
- STATE-OF-THE-ART TASKS AND ACHIEVEMENTS OF PARALINGUISTIC SPEECH ANALYSIS SYSTEMS
- HIGH-STABLE ERBIUM SUPERLUMINESCENT FIBER OPTICAL SOURCES CREATION METHODS
- ANALYSIS OF PULSE OPTICAL TARGET SEEKER STATIC CHARACTERISTICS AT TARGET AIRCRAFTS EXPOSURE
- INFLUENCE OF SURFACE TREATMENT AND PURIFICATION METHODS OF CO-115M GLASS-CERAMICS ON OPTICAL CONTACT STRENGTH
- ROBUST ALGORITHMS OF PARAMETRIC ESTIMATION IN SOME STABILIZATION PROBLEMS
- INTERVAL STATE ESTIMATION FOR SINGULAR DIFFERENTIAL EQUATION SYSTEMS WITH DELAYS
- USAGE OF PRESSURE OSCILLATIONS OF FLUCTUATING GAS FLOW FOR HANDLING OF 40X HARDENED STEEL SAMPLES
- SYNTHESIS, STRUCTURE AND SPECTRAL PROPERTIES OF POTASSIUMALUMINA- BORATE GLASS WITH NANOCRYSTALS OF MANGANESE FERRITE
- EVALUATION CRITERIA AND MODELS OF INFORMATION SYSTEMS WITH THE PROPERTY OF BEHAVIOR
- DYNAMIC SOFTWARE TESTING MODELS WITH PROBABILISTIC PARAMETERS FOR FAULT DETECTION AND ERLANG DISTRIBUTION FOR FAULT RESOLUTION DURATION
- DISTANCE MEASUREMENT BASED ON A SINGLE DEFOCUSED PHOTOGRAPH
- APPLICATION OF BINARY DESCRIPTORS TO MULTIPLE FACE TRACKING IN VIDEO SURVEILLANCE SYSTEMS
- PRECISION, SPEED AND COMPLEXITY OF DEVICES FOR IMAGE CODING BY CONTROL POINTS
- VISUAL CONCEPT LEARNING SYSTEM BASED ON LEXICAL ELEMENTS AND FEATURE KEY POINTS CONJUNCTION
- IMPLEMENTATION OF SIDE-CHANNEL LEAKAGE DETECTION TECHNIQUE BASED ON NORMALIZED INTER-CLASS VARIANCE METHOD
- DEVELOPMENT OF AUTOMATED SPEECH RECOGNITION SYSTEM FOR EGYPTIAN ARABIC PHONE CONVERSATIONS
- SVC VIDEO STREAM ALLOCATION AND ADAPTATION IN HETEROGENEOUS NETWORK
- MOLECULAR DYNAMICS SIMULATION OF LYSINE DENDRIMER AND SEMAX PEPTIDES INTERACTION
- CURRENT-VOLTAGE CHARACTERISTICS FOR TWO SYSTEMS OF QUANTUM WAVEGUIDES WITH CONNECTED QUANTUM RESONATORS
- MODEL STUDY OF THE DOUBLE FED MACHINE WITH CURRENT CONTROL
- COMPUTER SIMULATION OF ELECTROMAGNETIC LOG SENSOR STRENGTH CHARACTERISTICS
- STUDY OF STRONG CONFINEMENT OF CADMIUM SELENIDE QUANTUM DOTS IN FLUORINE-PHOSPHATE GLASSES
- TECHNICAL VISION SYSTEM FOR THE ROBOTIC MODEL OF SURFACE VESSEL
- STUDY OF SILVER CHLORIDE NANOCRYSTALS GROWTH IN FLUORINE PHOSPHATE GLASS