Covering formulation, algorithms, and structural results, and linking theory to real-world applications in controlled sensing (including social learning, adapti

This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time M

Put together by two top researchers in the Far East, this text examines Markov Decision Processes - also called stochastic dynamic programming - and their appli