Markov Chain Monte Carlo

Author: Dani Gamerman
Publisher: CRC Press
ISBN: 1584885874
Release Date: 2006-05-10
Genre: Mathematics

While there have been few theoretical contributions on the Markov Chain Monte Carlo (MCMC) methods in the past decade, current understanding and application of MCMC to the solution of inference problems has increased by leaps and bounds. Incorporating changes in theory and highlighting new applications, Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference, Second Edition presents a concise, accessible, and comprehensive introduction to the methods of this valuable simulation technique. The second edition includes access to an internet site that provides the code, written in R and WinBUGS, used in many of the previously existing and new examples and exercises. More importantly, the self-explanatory nature of the codes will enable modification of the inputs to the codes and variation on many directions will be available for further exploration. Major changes from the previous edition: · More examples with discussion of computational details in chapters on Gibbs sampling and Metropolis-Hastings algorithms · Recent developments in MCMC, including reversible jump, slice sampling, bridge sampling, path sampling, multiple-try, and delayed rejection · Discussion of computation using both R and WinBUGS · Additional exercises and selected solutions within the text, with all data sets and software available for download from the Web · Sections on spatial models and model adequacy The self-contained text units make MCMC accessible to scientists in other disciplines as well as statisticians. The book will appeal to everyone working with MCMC techniques, especially research and graduate statisticians and biostatisticians, and scientists handling data and formulating models. The book has been substantially reinforced as a first reading of material on MCMC and, consequently, as a textbook for modern Bayesian computation and Bayesian inference courses.

Markov Chain Monte Carlo in Practice

Author: W.R. Gilks
Publisher: CRC Press
ISBN: 0412055511
Release Date: 1995-12-01
Genre: Mathematics

In a family study of breast cancer, epidemiologists in Southern California increase the power for detecting a gene-environment interaction. In Gambia, a study helps a vaccination program reduce the incidence of Hepatitis B carriage. Archaeologists in Austria place a Bronze Age site in its true temporal location on the calendar scale. And in France, researchers map a rare disease with relatively little variation. Each of these studies applied Markov chain Monte Carlo methods to produce more accurate and inclusive results. General state-space Markov chain theory has seen several developments that have made it both more accessible and more powerful to the general statistician. Markov Chain Monte Carlo in Practice introduces MCMC methods and their applications, providing some theoretical background as well. The authors are researchers who have made key contributions in the recent development of MCMC methodology and its application. Considering the broad audience, the editors emphasize practice rather than theory, keeping the technical content to a minimum. The examples range from the simplest application, Gibbs sampling, to more complex applications. The first chapter contains enough information to allow the reader to start applying MCMC in a basic way. The following chapters cover main issues, important concepts and results, techniques for implementing MCMC, improving its performance, assessing model adequacy, choosing between models, and applications and their domains. Markov Chain Monte Carlo in Practice is a thorough, clear introduction to the methodology and applications of this simple idea with enormous potential. It shows the importance of MCMC in real applications, such as archaeology, astronomy, biostatistics, genetics, epidemiology, and image analysis, and provides an excellent base for MCMC to be applied to other fields as well.

Handbook of Markov Chain Monte Carlo

Author: Steve Brooks
Publisher: CRC Press
ISBN: 9781420079425
Release Date: 2011-05-10
Genre: Mathematics

Since their popularization in the 1990s, Markov chain Monte Carlo (MCMC) methods have revolutionized statistical computing and have had an especially profound impact on the practice of Bayesian statistics. Furthermore, MCMC methods have enabled the development and use of intricate models in an astonishing array of disciplines as diverse as fisheries science and economics. The wide-ranging practical importance of MCMC has sparked an expansive and deep investigation into fundamental Markov chain theory. The Handbook of Markov Chain Monte Carlo provides a reference for the broad audience of developers and users of MCMC methodology interested in keeping up with cutting-edge theory and applications. The first half of the book covers MCMC foundations, methodology, and algorithms. The second half considers the use of MCMC in a variety of practical applications including in educational research, astrophysics, brain imaging, ecology, and sociology. The in-depth introductory section of the book allows graduate students and practicing scientists new to MCMC to become thoroughly acquainted with the basic theory, algorithms, and applications. The book supplies detailed examples and case studies of realistic scientific problems presenting the diversity of methods used by the wide-ranging MCMC community. Those familiar with MCMC methods will find this book a useful refresher of current theory and recent developments.

Markov Chain Monte Carlo

Author: W. S. Kendall
Publisher: World Scientific
ISBN: 9789812564276
Release Date: 2005
Genre: Science

Markov Chain Monte Carlo (MCMC) originated in statistical physics, but has spilled over into various application areas, leading to a corresponding variety of techniques and methods. That variety stimulates new ideas and developments from many different places, and there is much to be gained from cross-fertilization. This book presents five expository essays by leaders in the field, drawing from perspectives in physics, statistics and genetics, and showing how different aspects of MCMC come to the fore in different contexts. The essays derive from tutorial lectures at an interdisciplinary program at the Institute for Mathematical Sciences, Singapore, which exploited the exciting ways in which MCMC spreads across different disciplines.

Markov Chain Monte Carlo Simulations and Their Statistical Analysis

Author: Bernd A. Berg
Publisher: World Scientific
ISBN: 9812389350
Release Date: 2004
Genre: Science

This book teaches modern Markov chain Monte Carlo (MC) simulation techniques step by step. The material should be accessible to advanced undergraduate students and is suitable for a course. It ranges from elementary statistics concepts (the theory behind MC simulations), through conventional Metropolis and heat bath algorithms, autocorrelations and the analysis of the performance of MC algorithms, to advanced topics including the multicanonical approach, cluster algorithms and parallel computing. Therefore, it is also of interest to researchers in the field. The book relates the theory directly to Web-based computer code. This allows readers to get quickly started with their own simulations and to verify many numerical examples easily. The present code is in Fortran 77, for which compilers are freely available. The principles taught are important for users of other programming languages, like C or C++.

Advanced Markov Chain Monte Carlo Methods

Author: Faming Liang
Publisher: Wiley
ISBN: 0470748265
Release Date: 2010-08-23
Genre: Mathematics

Markov Chain Monte Carlo (MCMC) methods are now an indispensable tool in scientific computing. This book discusses recent developments of MCMC methods with an emphasis on those making use of past sample information during simulations. The application examples are drawn from diverse fields such as bioinformatics, machine learning, social science, combinatorial optimization, and computational physics. Key Features: Expanded coverage of the stochastic approximation Monte Carlo and dynamic weighting algorithms that are essentially immune to local trap problems. A detailed discussion of the Monte Carlo Metropolis-Hastings algorithm that can be used for sampling from distributions with intractable normalizing constants. Up-to-date accounts of recent developments of the Gibbs sampler. Comprehensive overviews of the population-based MCMC algorithms and the MCMC algorithms with adaptive proposals. This book can be used as a textbook or a reference book for a one-semester graduate course in statistics, computational biology, engineering, and computer sciences. Applied or theoretical researchers will also find this book beneficial.

Stability of Markov Chain Monte Carlo Methods

Author: Kengo Kamatani
Publisher: Springer
ISBN: 4431552561
Release Date: 2015-08-05
Genre: Mathematics

This book presents modern techniques for the analysis of Markov chain Monte Carlo (MCMC) methods. A central focus is the study of the number of iteration of MCMC and the relation to some indices, such as the number of observation, or the number of dimension of the parameter space. The approach in this book is based on the theory of convergence of probability measures for two kinds of randomness: observation randomness and simulation randomness. This method provides in particular the optimal bounds for the random walk Metropolis algorithm and useful asymptotic information on the data augmentation algorithm. Applications are given to the Bayesian mixture model, the cumulative probit model, and to some other categorical models. This approach yields new subjects, such as the degeneracy problem and optimal rate problem of MCMC. Containing asymptotic results of MCMC under a Bayesian statistical point of view, this volume will be useful to practical and theoretical researchers and to graduate students in the field of statistical computing.

Advanced Markov Chain Monte Carlo Methods

Author: Faming Liang
Publisher: John Wiley & Sons
ISBN: 9781119956808
Release Date: 2011-07-05
Genre: Mathematics

Markov Chain Monte Carlo (MCMC) methods are now an indispensable tool in scientific computing. This book discusses recent developments of MCMC methods with an emphasis on those making use of past sample information during simulations. The application examples are drawn from diverse fields such as bioinformatics, machine learning, social science, combinatorial optimization, and computational physics. Key Features: Expanded coverage of the stochastic approximation Monte Carlo and dynamic weighting algorithms that are essentially immune to local trap problems. A detailed discussion of the Monte Carlo Metropolis-Hastings algorithm that can be used for sampling from distributions with intractable normalizing constants. Up-to-date accounts of recent developments of the Gibbs sampler. Comprehensive overviews of the population-based MCMC algorithms and the MCMC algorithms with adaptive proposals. This book can be used as a textbook or a reference book for a one-semester graduate course in statistics, computational biology, engineering, and computer sciences. Applied or theoretical researchers will also find this book beneficial.

Discretization and MCMC Convergence Assessment

Author: Christian Robert
Publisher: Springer Science & Business Media
ISBN: 0387985913
Release Date: 1998-08-13
Genre: Mathematics

This monograph proposes several approaches to convergence monitoring for MCMC algorithms which are centered on the theme of discrete Markov chains. After a short introduction to MCMC methods, including recent developments like perfect simulation and Langevin Metropolis-Hastings algorithms, and to the current convergence diagnostics, the contributors present the theoretical basis for a study of MCMC convergence using discrete Markov chains and their specificities. The contributors stress in particular that this study applies in a wide generality, starting with latent variable models like mixtures, then extending the scope to chains with renewal properties, and concluding with a general Markov chain. They then relate the different connections with discrete or finite Markov chains with practical convergence diagnostics which are either graphical plots (allocation map, divergence graph, variance stabilizing, normality plot), stopping rules (normality, stationarity, stability tests), or confidence bounds (divergence, asymptotic variance, normality). Most of the quantitative tools take advantage of manageable versions of the CLT. The different methods proposed here are first evaluated on a set of benchmark examples and then studied on three full scale realistic applications, along with the standard convergence diagnostics: A hidden Markov modelling of DNA sequences, including a perfect simulation implementation, a latent stage modelling of the dynamics of HIV infection, and a modelling of hospitalization duration by exponential mixtures. The monograph is the outcome of a monthly research seminar held at CREST, Paris, since 1995. The seminar involved the contributors to this monograph and was led by Christian P. Robert, Head of the Satistics Laboratory at CREST and Professor of Statistics at the University of Rouen since 1992.

Introducing Monte Carlo Methods with R

Author: Christian Robert
Publisher: Springer Science & Business Media
ISBN: 9781441915757
Release Date: 2009-12-10
Genre: Computers

This book covers the main tools used in statistical simulation from a programmer’s point of view, explaining the R implementation of each simulation technique and providing the output for better understanding and comparison.

Monte Carlo Statistical Methods

Author: Christian Robert
Publisher: Springer Science & Business Media
ISBN: 9781475741452
Release Date: 2013-03-14
Genre: Mathematics

We have sold 4300 copies worldwide of the first edition (1999). This new edition contains five completely new chapters covering new developments.

Probabilistic Methods for Algorithmic Discrete Mathematics

Author: Michel Habib
Publisher: Springer Science & Business Media
ISBN: 9783662127889
Release Date: 2013-03-14
Genre: Mathematics

Leave nothing to chance. This cliche embodies the common belief that ran domness has no place in carefully planned methodologies, every step should be spelled out, each i dotted and each t crossed. In discrete mathematics at least, nothing could be further from the truth. Introducing random choices into algorithms can improve their performance. The application of proba bilistic tools has led to the resolution of combinatorial problems which had resisted attack for decades. The chapters in this volume explore and celebrate this fact. Our intention was to bring together, for the first time, accessible discus sions of the disparate ways in which probabilistic ideas are enriching discrete mathematics. These discussions are aimed at mathematicians with a good combinatorial background but require only a passing acquaintance with the basic definitions in probability (e.g. expected value, conditional probability). A reader who already has a firm grasp on the area will be interested in the original research, novel syntheses, and discussions of ongoing developments scattered throughout the book. Some of the most convincing demonstrations of the power of these tech niques are randomized algorithms for estimating quantities which are hard to compute exactly. One example is the randomized algorithm of Dyer, Frieze and Kannan for estimating the volume of a polyhedron. To illustrate these techniques, we consider a simple related problem. Suppose S is some region of the unit square defined by a system of polynomial inequalities: Pi (x. y) ~ o.

Image Analysis Random Fields and Markov Chain Monte Carlo Methods

Author: Gerhard Winkler
Publisher: Springer Science & Business Media
ISBN: 9783642557606
Release Date: 2012-12-06
Genre: Mathematics

"This book is concerned with a probabilistic approach for image analysis, mostly from the Bayesian point of view, and the important Markov chain Monte Carlo methods commonly used....This book will be useful, especially to researchers with a strong background in probability and an interest in image analysis. The author has presented the theory with rigor...he doesn’t neglect applications, providing numerous examples of applications to illustrate the theory." -- MATHEMATICAL REVIEWS

Image Analysis Random Fields and Dynamic Monte Carlo Methods

Author: Gerhard Winkler
Publisher: Springer Science & Business Media
ISBN: 9783642975226
Release Date: 2012-12-06
Genre: Mathematics

This text is concerned with a probabilistic approach to image analysis as initiated by U. GRENANDER, D. and S. GEMAN, B.R. HUNT and many others, and developed and popularized by D. and S. GEMAN in a paper from 1984. It formally adopts the Bayesian paradigm and therefore is referred to as 'Bayesian Image Analysis'. There has been considerable and still growing interest in prior models and, in particular, in discrete Markov random field methods. Whereas image analysis is replete with ad hoc techniques, Bayesian image analysis provides a general framework encompassing various problems from imaging. Among those are such 'classical' applications like restoration, edge detection, texture discrimination, motion analysis and tomographic reconstruction. The subject is rapidly developing and in the near future is likely to deal with high-level applications like object recognition. Fascinating experiments by Y. CHOW, U. GRENANDER and D.M. KEENAN (1987), (1990) strongly support this belief.