A generalized Pólya's urn with graph based interactions: convergence at linearity
Cyrille Lucas (Weizmann Institute of Science and Université Paris Diderot)
Abstract
We consider a special case of the generalized Pólya's urn model. Given a finite connected graph $G$, place a bin at each vertex. Two bins are called a pair if they share an edge of $G$. At discrete times, a ball is added to each pair of bins. In a pair of bins, one of the bins gets the ball with probability proportional to its current number of balls. A question of essential interest for the model is to understand the limiting behavior of the proportion of balls in the bins for different graphs $G$. In this paper, we present two results regarding this question. If $G$ is not balanced-bipartite, we prove that the proportion of balls converges to some deterministic point $v=v(G)$ almost surely. If $G$ is regular bipartite, we prove that the proportion of balls converges to a point in some explicit interval almost surely. The question of convergence remains open in the case when $G$ is non-regular balanced-bipartite.
Full Text: Download PDF | View PDF online (requires PDF plugin)
Pages: 1-13
Publication Date: October 3, 2014
DOI: 10.1214/ECP.v19-3094
References
- Benaïm, Michel. A dynamical system approach to stochastic approximations. SIAM J. Control Optim. 34 (1996), no. 2, 437--472. MR1377706
- Benaïm, Michel. Dynamics of stochastic approximation algorithms. Séminaire de Probabilités, XXXIII, 1--68, Lecture Notes in Math., 1709, Springer, Berlin, 1999. MR1767993
- Bena"im, M., Benjamini, I., Chen, J., Lima, Y., A generalized pólya's urn with graph based interactions, 2013, Random structures and algorithms,
- Benaïm, Michel; Hirsch, Morris W. Asymptotic pseudotrajectories and chain recurrent flows, with applications. J. Dynam. Differential Equations 8 (1996), no. 1, 141--176. MR1388167
- Duflo, Marie. Algorithmes stochastiques. (French) [Stochastic algorithms] Mathématiques & Applications (Berlin) [Mathematics & Applications], 23. Springer-Verlag, Berlin, 1996. xiv+319 pp. ISBN: 3-540-60699-8 MR1612815
- Durrett, Rick. Probability: theory and examples. Fourth edition. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge, 2010. x+428 pp. ISBN: 978-0-521-76539-8 MR2722836
- Hirsch, M. W.; Pugh, C. C.; Shub, M. Invariant manifolds. Lecture Notes in Mathematics, Vol. 583. Springer-Verlag, Berlin-New York, 1977. ii+149 pp. MR0501173
- Lima, Y., Graph-based Pólya's urn: completion of the linear case, 2014, arXiv preprint arXiv:1409.7826
- Schreiber, Sebastian J. Expansion rates and Lyapunov exponents. Discrete Contin. Dynam. Systems 3 (1997), no. 3, 433--438. MR1444204

This work is licensed under a Creative Commons Attribution 3.0 License.