Analysis of Markov Chain Models of Adaptive Processes

Download or read book Analysis of Markov Chain Models of Adaptive Processes written by K. R. Kaplan and published by . This book was released on 1965 with total page 116 pages. Available in PDF, EPUB and Kindle. Book excerpt: Learning and adaptation are considered to be stochastic in nature by most modern psychologists and by many engineers. Markov chains are among the simplest and best understood models of stochastic processes and, in recent years, have frequently found application as models of adaptive processes. A number of new techniques are developed for the analysis of synchronous and asynchronous Markov chains, with emphasis on the problems encountered in the use of these chains as models of adaptive processes. Signal flow analysis yields simplified computations of asymptotic success probabilities, delay times, and other indices of performance. The techniques are illustrated by several examples of adaptive processes. These examples yield further insight into the relations between adaptation and feedback. (Author).