This book is written for computer scientists, graduate students, and researchers studying artificial intelligence, machine learning, reinforcement learning, learning automata techniques, and engineers working on real-world problem-solving in engineering domains. In particular, the reader is assumed already familiar with basic mathematics, statistics, probability, and algorithm. Prior exposure to mathematics, stochastic process, and learning automata is helpful but not necessary. The book in detail describes verities of learning automaton models and their recent developments of applications in solving real-world problems and optimization with detailed mathematical and theoretical perspectives. This book consists of nine chapters devoted to the theory of learning automata and cellular learning automata models for optimization. Chapter 1 gives a preliminary introduction and an overview of various learning automata models and static and dynamic optimization concepts. Chapter 2 provides a bibliometric analysis of the research studies on learning automata and optimization as a systematic review. Chapter 3 is dedicated to describing the recent hybrid algorithms with the aid of cellular learning automata. Chapter 4 is devoted to learning automata for behavior control in evolutionary computation in local and global optimization. In Chapter 5, applications of a memetic model of learning automata for solving NP-hard problems are discussed. Chapter 6 provides object migration automata for solving graph and network problems. Chapter 7 gives an overview of multi-population methods for dynamic environments. Chapter 8 describes learning automata for online function evaluation management in evolutionary multi-population methods for dynamic optimization problems. Finally, Chapter 9 provides a detailed discussion on function management in multi-population methods with a variable number of populations using a learning automaton approach. The authors would like to thank Dr. Thomas Ditzinger, Springer, Editorial Director & Interdisciplinary Applied Sciences, Holger Schaepe, Senior Editorial Assistant, Springer-Verlag Heidelberg in Engineering Editorial, Silvia Schneider, and Ms. Varsha Prabakaran, Project Coordinator & Books Production administrator of Springer Nature, for the editorial assistance, cooperative collaboration, excellent support, and Saranya Kalidoss for providing continuous assistance and advice vii