A Numerical Scheme for Invariant Distributions of Constrained Diffusions

Abstract : Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the corresponding stochastic networks and thus it is important to develop reliable and efficient algorithms for numerical computation of such distributions. In this work we propose and analyze a Monte- Carlo scheme based on an Euler type discretization of the reflected stochastic differential equation using a single sequence of time discretization steps which decrease to zero as time approaches infinity. Appropriately weighted empirical measures constructed from the simulated discretized reflected diffusion are proposed as approximations for the invariant probability measure of the true diffusion model. Almost sure consistency results are established that in particular show that weighted averages of polynomially growing continuous functionals evaluated on the discretized simulated system converge a.s. to the corresponding integrals with respect to the invariant measure. Proofs rely on constructing suitable Lyapunov functions for tightness and uniform integrability and characterizing almost sure limit points through an extension of Echeverria's criteria for reflected diffusions. Regularity properties of the underlying Skorohod problems play a key role in the proofs. Rates of convergence for suitable families of test functions are also obtained. A key advantage of Monte-Carlo methods is the ease of implementation, particularly for high dimensional problems. A numerical example
Document type :
Journal articles
Complete list of metadatas

https://hal.univ-cotedazur.fr/hal-00622153
Contributor : Sylvain Rubenthaler <>
Submitted on : Monday, September 12, 2011 - 9:55:08 AM
Last modification on : Friday, January 12, 2018 - 1:50:59 AM
Long-term archiving on : Tuesday, December 13, 2011 - 2:21:13 AM

Files

rbmnumericMOR.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00622153, version 1
  • DOI : 10.1287

Collections

Citation

Amarjit Budhiraja, Jiang Chen, Sylvain Rubenthaler. A Numerical Scheme for Invariant Distributions of Constrained Diffusions. Mathematics of Operations Research., 2013, pp.moor.2013.0599. ⟨10.1287⟩. ⟨hal-00622153⟩

Share

Metrics

Record views

456

Files downloads

733