Journal
Scientific and technical journal of information technologies, mechanics and optics
UDK
Issue:2 (78)
DATA ANALYSIS BY SQL-MAPREDUCE PLATFORM
Annotation
The paper deals with the problems related to the usage of relational database management system (RDBMS), mainly in the analysis of large data content, including data analysis based on web services in the Internet. A solution of these problems can be represented as a web-oriented distributed system of the data analysis with the processor of service requests as an executive kernel. The functions of such system are similar to the functions of relational DBMS, only with the usage of web services. The processor of service requests is responsible for planning of data analysis web services calls and their execution. The efficiency of such web-oriented system depends on the efficiency of web services calls plan and their program implementation where the basic element is the facilities of analyzed data storage – relational DBMS. The main attention is given to extension of functionality of relational DBMS for the analysis of large data content, in particular, the perspective estimation of web services data analysis implementation on the basis of SQL/MapReduce platform. With a view of obtaining this result, analytical task was chosen as an application-oriented part, typical for data analysis in various social networks and web portals, based on data analysis of users’ attendance. In the practical part of this research the algorithm for planning of web services calls was implemented for application-oriented task solution. SQL/MapReduce platform efficiency is confirmed by experimental results that show the opportunity of effective application for data analysis web services.
Keywords
Постоянный URL
Articles in current issue
- OPTICAL CONTROL IN THE QUALITY MANAGEMENT SYSTEM OF PISTON RINGS PRODUCTION
OPTICAL SPECTRAL TECHNOLOGIES APPLICATION FOR CONTROL AND DIAGNOSTICS OF BLEACHING WORKS IN THE PULP AND PAPER INDUSTRY
- REMOTE LASER IDENTIFICATION OF THE BUILDING MATERIAL TYPE
- DYNAMIC PARAMETERS OPTIMIZATION FOR TRIGGER TYPE OPTICAL PROBE
- Genomic variants’ analysis of Escherichia coli K-12 cells resistant to phage T7 infection
- Тест
- ANALYSIS OF INTERFEROMETER DATA PROCESSING METHODS IN SPECTRAL OPTICAL COHERENCE TOMOGRAPHY ТОМОГРАФИИ
- RECONSTRUCTION OF DIGITAL FOURIER HOLOGRAM IN CASE OF NYQUIST FREQUENCY EXCESS
- SMALL DISPLACEMENTS DETERMINATION OF OBJECTS SURFACE BY DIGITAL HOLOGRAPHY METHODS
- TERAHERTZ TRANSMISSION AND REFLECTION SPECTRA OF CATARACT MODIFIED HUMAN CRYSTALLINE LENS
- FORMATION OF THE ALGORITHMIC RECURSIVE CORRECTION FOR SYSTEMATIC CODES MULTIPLE ERRORS BASED ON QUASI-SYNDROMES IN THE RATE OF HARDWARE TIME
- PHYSICAL PROCESSES RESEARCH IN THE PULSE XENON LAMP AT THE PUMP ELECTRICAL CIRCUIT OPERATION ON THE BASIS OF MODULATOR WITH THE PARTIAL DISCHARGE CONDENSER
- SYNTHESIS OF OPTIMAL ARTIFICIAL NEURAL NETWORKS BY MODIFIED GENETIC ALGORITHM
- CONTROL SYSTEM IDENTIFICATION AND ADJUSTMENT FOR THE ELECTRO DRIVE OF TELESCOPE AZIMUTHAL AXIS
- PROBLEM-ORIENTED AGENT-BASED PLATFORM OF MULTI MODEL COMPLEXES DESIGN FOR REGIONAL SAFETY MANAGEMENT SUPPORT
- SYSTEMS OF DUPLICATED COMPUTER COMPLEXES WITH REQUESTS REALLOCATION
- DE BRUIJN SEQUENCES APPLICATION FOR PSEUDO REGULAR CODE SCALES GENERATION
- DEVELOPMENT PROBLEMS OF THE ENTERPRISE IT- INFRASTRUCTURE
- KINEMATIC CONTROL OF TWO-PARAMETRICAL SCANNING AERIAL
- QUANTITATIVE DESCRIPTION OF NONLINEAR DYNAMICS IN THE POROUS ACRYLIC THIN FILM
- METHOD OF THE FREE-CONVECTION HEAT EXCHANGE CALCULATION ON SOLID SURFACES IN A WIDE TEMPERATURE RANGE
- MATHEMATICAL ESTIMATION MODELS OF INFORMATION SECURITY SYSTEM INFRASTRUCTURE AT THE ENTERPRISE
- MALWARE DETECTION METHOD BASED ON THE PROGRAM DISTRIBUTION PROCESS ANALYSIS
- PROBABILISTIC ANALYSIS MODEL FOR INFORMATION INFLUENCE
- INFORMATION PROTECTION AGAINST INTENTIONAL ELECTROMAGNETIC INFLUENCES
- INTEGRATED ENGINEERING DESIGN TECHNOLOGIES FOR POLYMERIC COMPOSITE MATERIALS
- PRODUCT SURFACE QUALITY PROVIDING ON ELECTRO-EROSION EQUIPMENT
- MANAGEMENT SCIENTIFIC PRECONDITIONS FOR INTELLECTUAL PROPERTY IN THE PROBLEMS DECISION OF INNOVATIVE DEVELOPMENT OF RUSSIA
- METHODOLOGICAL BASIS OF SUSTAINABILITY AND SUSTAINABLE DEVELOPMENT OF BUSINESS STRUCTURES AS SOCIO-ECONOMIC SYSTEMS
- RISK MANAGEMENT SYSTEM IMPROVEMENT FOR GOODS AND VEHICLES MOVEMENT THROUGH CUSTOMS BORDER OF THE RUSSIAN FEDERATION
- INNOVATION STAGES DISTRIBUTION OF VENTURE CAPITAL INVESTMENTS IN RUSSIA AND THE UNITED STATES
- PROJECT MANAGEMENT MODEL FOR UNIVERSITY MAIN COMPETENCE-ORIENTED EDUCATIONAL PROGRAMS
- TEMPERATURE DEPENDENCE OF REFRACTION INDEX FOR ETHYLENE GLYCOL AND PROPYLENE GLYCOL AQUEOUS SOLUTIONS
- SOFTWARE ARCHITECTURE FOR THE AUTOMATED WORKPLACE OF THE ONBOARD AVIATION EQUIPMENT DEVELOPER
- LIFE CYCLE “DESIGN-MANUFACTURE-OPERATION” REALIZATION FOR ONBOARD EQUIPMENT AT THE AVIATION INDUSTRY ENTERPRISES
- ON THE INFORMATION SECURITY WORKS AGAINST INTENTIONAL ELECTROMAGNETIC INFLUENCES
- CONSOLIDATION OF DIVERSE CHANNELS OF COMPUTER NETWORK
- ESTIMATION OF FUNCTIONAL SAFETY FOR THE DUPLICATED COMPUTING SYSTEMS
- FINANCIAL PLANNING SYSTEMS REVIEW IN THE MARKET OF KAZAKHSTAN
- MUSICAL COMPUTER TECHNOLOGIES IN THE MODERN PROFESSIONAL MUSIC EDUCATION