ANALYTICAL APPROACH TO SELECTIVE SEARCH FOR STATE PROBABILITY FUNCTIONS IN MARKOV CHAINS
Annotation
An analytical approach to studying countable homogeneous Markov chains is proposed. An algorithm for selective search of input-output operators in z-form is presented. Simple analytical procedures for obtaining probability functions for real and complex conjugate eigenvalues of the transition probability matrix are described. Estimates are given for the boundaries of the onset of a steady state in clock time. Additional results are presented for the steady state using an algorithm for expanding the characteristic determinants. The main calculations are illustrated by assessing the characteristics of Markov chains taking into account the influence of transient dynamics when changing the probabilities of states over the operating interval in clock time. Aspects of calculation reliability when estimating probability values using the proposed approach are also considered.
Keywords
Постоянный URL
Articles in current issue
- APPLICATION OF BIG DATA METHODS FOR COMPARING DATA OF GEOMAGNETIC OBSERVATORIES IN THE INTERMAGNET NETWORK
- PHENOMENOLOGICAL DESCRIPTION OF INTERNET DOCUMENTS COLLECTING AND PROCESSING
- DIGITAL IMPLEMENTATION OF VARIABLE DELAY IN MODELING AND CONTROL SYSTEMS
- PRACTICAL APPLICATION OF WORKPLACE MODELS FOR VERIFICATION OF MEASURING INSTRUMENTS AS NON-STATIONARY SERVICE SYSTEMS
- ANALYTICAL APPROACH TO SELECTIVE SEARCH FOR STATE PROBABILITY FUNCTIONS IN MARKOV CHAINS
- PARAMETERIZATION ALGORITHM FOR NON-STATIONARY SYSTEMS USING A DYNAMIC CONTROLLER
- EVALUATION OF MATERIAL HARDNESS USING WEAR TESTING BY CHORD METHOD
- THE USE OF SWARM ALGORITHMS IN TECHNOLOGICAL PREPARATION OF PRODUCTION
- INDEX OF ARTICLES PUBLISHED IN 2023