Sufficient Conditions for Torpid Mixing of Parallel and Simulated Tempering
Dublin Core | PKP Metadata Items | Metadata for this Document | |
1. | Title | Title of document | Sufficient Conditions for Torpid Mixing of Parallel and Simulated Tempering |
2. | Creator | Author's name, affiliation, country | Dawn B Woodard; Cornell University |
2. | Creator | Author's name, affiliation, country | Scott C Schmidler; Duke Universtity |
2. | Creator | Author's name, affiliation, country | Mark Huber; Duke University |
3. | Subject | Discipline(s) | |
3. | Subject | Keyword(s) | Markov chain, rapid mixing, spectral gap, Metropolis algorithm |
3. | Subject | Subject classification | 65C40 |
4. | Description | Abstract | We obtain upper bounds on the spectral gap of Markov chains constructed by parallel and simulated tempering, and provide a set of sufficient conditions for torpid mixing of both techniques. Combined with the results of Woodard, Schmidler and Huber (2009), these results yield a two-sided bound on the spectral gap of these algorithms. We identify a persistence property of the target distribution, and show that it can lead unexpectedly to slow mixing that commonly used convergence diagnostics will fail to detect. For a multimodal distribution, the persistence is a measure of how ``spiky'', or tall and narrow, one peak is relative to the other peaks of the distribution. We show that this persistence phenomenon can be used to explain the torpid mixing of parallel and simulated tempering on the ferromagnetic mean-field Potts model shown previously. We also illustrate how it causes torpid mixing of tempering on a mixture of normal distributions with unequal covariances in R^M, a previously unknown result with relevance to statistical inference problems. More generally, anytime a multimodal distribution includes both very narrow and very wide peaks of comparable probability mass, parallel and simulated tempering are shown to mix slowly. |
5. | Publisher | Organizing agency, location | |
6. | Contributor | Sponsor(s) | |
7. | Date | (YYYY-MM-DD) | 2009-03-31 |
8. | Type | Status & genre | Peer-reviewed Article |
8. | Type | Type | |
9. | Format | File format | |
10. | Identifier | Uniform Resource Identifier | http://ejp.ejpecp.org/article/view/638 |
10. | Identifier | Digital Object Identifier | 10.1214/EJP.v14-638 |
11. | Source | Journal/conference title; vol., no. (year) | Electronic Journal of Probability; Vol 14 |
12. | Language | English=en | |
14. | Coverage | Geo-spatial location, chronological period, research sample (gender, age, etc.) | |
15. | Rights | Copyright and permissions | The Electronic Journal of Probability applies the Creative Commons Attribution License (CCAL) to all articles we publish in this journal. Under the CCAL, authors retain ownership of the copyright for their article, but authors allow anyone to download, reuse, reprint, modify, distribute, and/or copy articles published in EJP, so long as the original authors and source are credited. This broad license was developed to facilitate open access to, and free use of, original works of all types. Applying this standard license to your work will ensure your right to make your work freely and openly available. Summary of the Creative Commons Attribution License You are free
|