Home | Current | Past volumes | About | Login | Notify | Contact | Search
 Probability Surveys > Vol. 11 (2014) open journal systems 


On the notion(s) of duality for Markov processes

Sabine Jansen, Leiden University
Noemi Kurt, TU Berlin


Abstract
We provide a systematic study of the notion of duality of Markov processes with respect to a function. We discuss the relation of this notion with duality with respect to a measure as studied in Markov process theory and potential theory and give functional analytic results including existence and uniqueness criteria and a comparison of the spectra of dual semi-groups. The analytic framework builds on the notion of dual pairs, convex geometry, and Hilbert spaces. In addition, we formalize the notion of pathwise duality as it appears in population genetics and interacting particle systems. We discuss the relation of duality with rescalings, stochastic monotonicity, intertwining, symmetries, and quantum many-body theory, reviewing known results and establishing some new connections.

AMS 2000 subject classifications: Primary: 60J25. Secondary: 46N30, 47D07, 60J05

Keywords: Markov processes, duality, semi-groups, cone duality, time reversal, interacting particle systems

Creative Common LOGO

Full Text: PDF


Jansen, Sabine, Kurt, Noemi, On the notion(s) of duality for Markov processes, Probability Surveys, 11, (2014), 59-120 (electronic). DOI: 10.1214/12-PS206.

References

[AN94]     Aizenman, M., Nachtergaele, B., Geometric aspects of quantum spin states. Comm. Math. Phys. 164(1):17–63 (1994). MR1288152

[AH07]     Alkemper, R., Hutzenthaler, M., Graphical representation of some duality relations in stochastic population models. Electr. Comm. Prob. 12:206–220 (2007). MR2320823

[Asm03]     Asmussen, S., Applied probability and queues. 2nd edition, Springer-Verlag, New York, 2003. MR1978607

[AS96]     Asmussen, S., Sigman, K., Monotone stochastic recursion and their duals. Prog. Eng. Inf. Sci. 10:1–20 (1996). MR1386851

[AS12]     Athreya, S., Swart, J., Systems of branching, annihilating, and coalescing particles. Electron. Journ. Prob. 17(80):1–32 (2012). MR2981905

[AT00]     Athreya, S., Tribe, R., Uniqueness for a class of one-dimensional stochastic pdes using moment duality. The Annals of Probability 28(4):1711–1734 (2000). MR1813840

[BLG03]     Bertoin, J., Le Gall, J.-F., Stochastic flows associated to coalescent processes. Prob. Theory Rel. Fields 126(2):261–288 (2003). MR1990057

[BBMST]     Birkner, M., Möhle, J. M., Steinrücken, M., Tams, J., A modified lookdown construction for the Xi-Fleming-Viot process with mutation and populations with recurrent bottlenecks. Alea 6:25–61 (2009). MR2485878

[BG68]     Blumenthal, R. M., Getoor, R. K., Markov processes and potential theory. Pure and Applied Mathematics, vol. 29, Academic Press, New York London, 1968. MR0264757

[Bog07]     Bogachev, V. I., Measure theory, Volume 2. Springer-Verlag, Berlin Heidelberg, 2007. MR2267655

[BR87]     Bratteli, O., Robinson, D. W., Operator algebras and quantum statistical mechanics, vol. 1. 2nd edition, Springer, 1987. MR0545651

[CPY98]     Carmona, Ph., Petit, F., Yor, M., Beta-gamma random variables and intertwining relations between certain Markov processes. Rev. Mat. Iberoamericana 14(2):311–367 (1998). MR1654531

[CW05]     Chung, K. L., Walsh, J. B., Markov processes, Brownian motion, and time symmetry. 2nd edition, Springer, New York, 2005. MR2152573

[CR84]     Cox, J. Th., Rösler, U., A duality relation for entrance and exit laws for Markov processes. Stochastic Process. Appl. 16(2):141–156 (1984). MR0724061

[CS85]     Clifford, P., Sudbury, A., A sample path proof of the duality for stochastically monotone Markov processes. Ann. Probab. 13(2):558–565 (1985). MR0781422

[DG14]     Dawson, D., Greven, A., Spatial Fleming-Viot models with selection and mutation. Lecture Notes in Mathematics, vol. 2092, Springer, 2014. MR3155790

[DK82]     Dawson, D., Kurtz, T., Applications of duality to measure-valued diffusion processes. In Advances in filtering and optimal stochastic control (Cocoyoc, 1982). Lecture Notes in Control and Inform. Sci., vol. 42, pages 91–105, Springer, 1982. MR0794506

[DMP91]     De Masi, A., Presutti, E., Mathematical methods for hydrodynamic limits. Lecture Notes in Mathematics, vol. 1501, Springer, Berlin, 1991. MR1175626

[DFPS]     Dette, H., Fill, J. A., Pitman, J., Studden, W. J., Wall and Siegmund duality relations for birth and death chains with reflecting barrier. J. Theor. Probab. 10:349–374 (1997). MR1455149

[DF90]     Diaconis, P., Fill, J. A., Strong stationary times via a new form of duality. Ann. Probab. 18:1483–1522 (1990). MR1071805

[Doi76]     Doi, M., Second quantization representation for classical many-particle system. J. Phys. A: Math. Gen. 9:1465–1477 (1976).

[DK96]     Donnelly, P., Kurtz, Th. G., A countable representation of the Fleming-Viot measure valued diffusion. Ann. Probab. 24(2):698–742 (1996). MR1404525

[DK99]     Donnelly, P., Kurtz, Th. G., Particle representations for measure-valued population models. Ann. Probab. 27(1):166–205 (1999). MR1681126

[DM09]     Diaconis, P., Miclo, L., On times to quasi-stationarity for birth and death processes. J. Theoret. Probab. 22(3):558–586 (2009). MR2530103

[Dyn65]     Dynkin, E. B., Markov Processes. Springer, 1965.

[Eth06]     Etheridge, A., Evolution in fluctuating populations. In Mathematical statistical physics, pages 489–545, Elsevier B. V., Amsterdam, 2006. MR2581892

[Eth11]     Etheridge, A., Some mathematical models from population genetics. Lecture Notes in Mathematics, Springer, 2011. MR2759587

[EK95]     Ethier, S. N., Krone, S. M., Comparing Fleming-Viot and Dawson-Watanabe processes. Stoch. Proc. Appl. 60:401–421 (1995). MR1376800

[EK86]     Ethier, S. N., Kurtz, Th. G., Markov processes, characterization and convergence. Wiley Series in Probability and Mathematical Statistics, Wiley, New York, 1986. MR0838085

[Fe71]     Feller, W., An introduction to probability theory and its applications, vol. 2. 2nd edition, Wiley, 1971. MR0270403

[Fil92]     Fill, J. A., Strong stationary duality for continuous-time Markov chains. I. Theory. J. Theoret. Probab. 5(1):45–70 (1992). MR1144727

[vG03]     van Gaans, O. W., Probability measures on metric spaces. Unpublished seminar notes, www.math.leidenuniv.nl/\textasciitildevangaans/jancol1.pdf.

[Ge10]     Getoor, R. K., Duality theory for Markov processes: Part I. arXiv:1002.2399v1 [Math.PR] (2010).

[GKRV09]     Giardina, C., Kurchan, J., Redig, F., Vafayi, K., Duality and hidden symmetries in interacting particle systems. Journal of Statistical Physics 135:25–55 (2009). MR2505724

[GSW11]     Goldschmidt, Ch., Ueltschi, D., Windridge, P., Quantum Heisenberg models and their probabilistic representations. Entropy and the quantum II. Contemp. Math. 552:177–224 (2011). MR2868048

[Gri79]     Griffeath, D., Additive and cancellative interacting particle systems. Lecture Notes in Mathematics, vol. 724, Springer, 1979. MR0538077

[GS92]     Gwa, L.-H., Spohn, H., Six-vertex model, roughened surfaces, and an asymmetric spin Hamiltonian. Phys. Rev. Lett. 68(6):725–728 (1992). MR1147356

[Har78]     Harris, T. E., Additive set-valued Markov processes and graphical methods. Ann. Probab. 6 (3):355–3778 (1978). MR0488377

[HR70]     Hewitt, E., Ross, K. A., Abstract harmonic analysis. Vol. II: Structure and analysis for compact groups. Analysis on locally compact Abelian groups. Die Grundlehren der mathematischen Wissenschaften, Band 152, Springer, New York Berlin, 1970. MR0262773

[Ho62]     Hoffman, K., Banach spaces of analytic functions. Prentice-Hall Series in Modern Analysis, 1962. MR0133008

[HL75]     Holley, R. A., Liggett, T. M., Ergodic theorems for weakly interacting infinite systems and the Voter model. Ann. Probab. 3(4):643–663 (1975). MR0402985

[HS76]     Holley, R., Stroock, D., Williams, D., Applications of dual processes to diffusion theory. Probability (Proc. Sympos. Pure Math., Vol. XXXI, Univ. Illinois, Urbana, Ill., 1976), 23–36 (1977). MR0443110

[HS79]     Holley, R., Stroock, D., Dual processes and thier application to infinite interacting systems. Adv. in Math. 32:149–174 (1979). MR0535620

[Hu58]     Hunt, G. A., Markov processes and potentials III. Illinois J. Math. 2:151–213 (1958). MR0107097

[HM11]     Huillet, T., Martinez, S., Duality and intertwining for discrete Markov kernels: relations and examples. Adv. in Appl. Probab. 43(2):437–460 (2011). MR2848385

[JK12]     Jansen, S., Kurt, N., Pathwise construction of certain moment dualities and application to population models with balancing selection. arXiv:1207.6056v1 (2012).

[KMG57]     Karlin, S., McGregor, J., The classification of birth and death processes. Trans. Amer. Math. Soc. 86:366–400 (1957). MR0094854

[Kir08]     Kirillov, A., Jr., An introduction to Lie groups and Lie algebras. Cambridge Studies in Advanced Mathematics, vol. 113, Cambridge University Press, Cambridge, 2008. MR2440737

[KRS07]     Klebaner, F., Rösler, U., Sagitov, S., Transformations of Galton-Watson proceses and linear fractional reproduction. Adv. Appl. Probab. 39:1036–1053 (2007). MR2381587

[Lev48]     Lévy, P., Processus stochastiques et mouvement Brownien. Gauthier-Villars, Paris, 1948. MR0190953

[Lig05]     Liggett, Th. M., Interacting particle systems. Classics in Mathematics, Springer-Verlag, Berlin, 2005. Reprint of the 1985 original. MR2108619

[Lin52]     Lindley, D., The theory of queues with a single server. Proc. Cambridge Philos. Soc. 48:277–289 (1952). MR0046597

[LSD96]     Lloyd, P., Sudbury, A., Donnelly, P., Quantum operators in classical probability theory. I. “Quantum spin” techniques and the exclusion model of diffusion. Stochastic Process. Appl. 61(2):205–221 (1996). MR1386173

[Möh99]     Möhle, M., The concept of duality and applications to Markov processes arising in neutral population genetics models. Bernoulli 5(5):761–777 (1999). MR1715438

[Möh11]     Möhle, M., Duality and cones of Markov processes and their semigroups, preprint (2011).

[Mor58]     Moran, P. A. P., Random processes in genetics. Proc. Cambridge Philos. Soc. 54:60–71 (1958). MR0127989

[Myt98]     Mytnik, L., Weak uniqueness for the heat equation with noise. The Annals of Probability 26,(3):968–984 (1998). MR1634410

[Pel85]     Peliti, L., Path integral approach to birth-death processes on a lattice. J. Phys. France 46:1469–1483 (1985).

[Ph01]     Phelps, R. R., Lectures on Choquet’s theorem. 2nd edition, Springer, 2001. MR1835574

[RS]     Reed, M., Simon, B., Modern methods of mathematical physics, Vol. 1: Functional analysis. Revised and enlarged edition, Academic Press Inc., 1980. MR0751959

[RW]     Rogers, L. C. G., Williams, D., Diffusions, Markov processes and matringales, Vol. I. 2nd edition, Cambridge University Press, 1994.

[SC01]     Saloff-Coste, L., Probability on groups: Random walks and invariant diffusions. Notices Amer. Math. Soc. 48(9):968–977 (2001). MR1854532

[SS94]     Schütz, G., Sandow, S., Non-Abelian symmetries of stochastic processes: Derivation of correlation functions for random-vertex models and disordered-interacting-particle systems. Phys. Rev. E 49:2726–2741 (1994).

[Sie76]     Siegmund, D., The equivalence of absorbing and reflecting barrier problems for stochastically monotone Markov processes. Ann. Probab. 4:914–924 (1976). MR0431386

[S00]     Sudbury, A., Dual families of interacting particle systems on graphs. J. Theor. Probab. 13(3):695–716 (2000). MR1785526

[SL95]     Sudbury, A., Lloyd, P., Quantum operators in classical probability theory. II. The concept of duality in interacting particle systems. Ann. Probab. 23(4):1816–1830 (1995). MR1379169

[SL97]     Sudbury, A., Lloyd, P., Quantum operators in classical probability theory. IV. Quasi-duality and thinnings of interacting particle systems. Ann. Probab. 25(1):96–114 (1997). MR1428501

[Spi70]     Spitzer, F., Interaction of Markov processes. Advances in Math. 5:246–290 (1970). MR0268959

[Sw06]     Swart, J., Duals and thinnings of some relatives of the contact process. arXiv:math.PR/0604335 (2006).

[Sw11]     Swart, J., Intertwining of birth-and-death processes. Kybernetika 47(1):1–14 (2011). MR2807860

[Sw13]     Swart, J., Duality and intertwining of Markov chains. Lecture notes for the ALEA in Europe School, Marseille 2013. Available at http://staff.utia.cas.cz/swart/dualtwine.pdf.

[Tó93]     Tóth, B., Improved lower bound on the thermodynamic pressure of the spin 1=2 Heisenberg ferromagnet. Lett. Math. Phys. 28(1):75–84 (1993). MR1224836

[Ver88]     Vervaat, W., Algebraic duality of Markov processes. In Mark Kac Seminar on Probability and Physics. Syllabus 1985–1987 (Amsterdam, 1985–1987). CWI Syllabi, vol. 17, pages 61–69, Math. Centrum Centrum Wisk. Inform., Amsterdam, 1988. MR0969621

[Wer00]     Werner, D., Funktionalanalysis. 3rd edition, Springer, 2000. MR1787146




Home | Current | Past volumes | About | Login | Notify | Contact | Search

Probability Surveys. ISSN: 1549-5787