Content area

Abstract

We study the rate at which the initial and current random variables become independent along a Markov chain, focusing on the Langevin diffusion in continuous time and the Unadjusted Langevin Algorithm (ULA) in discrete time. We measure the dependence between random variables via their mutual information. For the Langevin diffusion, we show the mutual information converges to \(0\) exponentially fast when the target is strongly log-concave, and at a polynomial rate when the target is weakly log-concave. These rates are analogous to the mixing time of the Langevin diffusion under similar assumptions. For the ULA, we show the mutual information converges to \(0\) exponentially fast when the target is strongly log-concave and smooth. We prove our results by developing the mutual version of the mixing time analyses of these Markov chains. We also provide alternative proofs based on strong data processing inequalities for the Langevin diffusion and the ULA, and by showing regularity results for these processes in mutual information.

Details

1009240
Title
On Independent Samples Along the Langevin Diffusion and the Unadjusted Langevin Algorithm
Publication title
arXiv.org; Ithaca
Publication year
2024
Publication date
Feb 26, 2024
Section
Computer Science; Mathematics; Statistics
Publisher
Cornell University Library, arXiv.org
Source
arXiv.org
Place of publication
Ithaca
Country of publication
United States
University/institution
Cornell University Library arXiv.org
e-ISSN
2331-8422
Source type
Working Paper
Language of publication
English
Document type
Working Paper
Publication history
 
 
Online publication date
2024-02-28
Milestone dates
2024-02-26 (Submission v1)
Publication history
 
 
   First posting date
28 Feb 2024
ProQuest document ID
2932594129
Document URL
https://www.proquest.com/working-papers/on-independent-samples-along-langevin-diffusion/docview/2932594129/se-2?accountid=208611
Full text outside of ProQuest
Copyright
© 2024. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Last updated
2024-02-29
Database
ProQuest One Academic