• DML-CZ Home

60J10 Markov chains with discrete parameter (30 articles)

• Randriamaro, Hery: A determinant formula from random walks. (English). Archivum Mathematicum, vol. 59 (2023), issue 5, pp. 421-431
• Kirkland, Steve: Random walk centrality and a partition of Kemeny's constant. (English). Czechoslovak Mathematical Journal, vol. 66 (2016), issue 3, pp. 757-775
• Agapie, Alexandru; Wright, Alden H.: Theoretical analysis of steady state genetic algorithms. (English). Applications of Mathematics, vol. 59 (2014), issue 5, pp. 509-525
• Sladký, Karel: Identification of optimal policies in Markov decision processes. (English). Kybernetika, vol. 46 (2010), issue 3, pp. 558-570
• Kocurek, Martin: Insensitivity analysis of Markov chains. (English). In: Chleboun, J., Přikryl, P., Segeth, K. and Šístek, J. (eds.): Programs and Algorithms of Numerical Mathematics. Proceedings of Seminar. Dolní Maxov, June 6-11, 2010. Institute of Mathematics AS CR, Prague, 2010. pp. 107-112
• Wang, Kangkang: A class of strong limit theorems for countable nonhomogeneous Markov chains on the generalized gambling system. (English). Czechoslovak Mathematical Journal, vol. 59 (2009), issue 1, pp. 23-37
• Sladký, Karel: Growth rates and average optimality in risk-sensitive Markov decision chains. (English). Kybernetika, vol. 44 (2008), issue 2, pp. 205-226
• Zaitseva, Elena: Stability estimating in optimal stopping problem. (English). Kybernetika, vol. 44 (2008), issue 3, pp. 400-415
• El-Shehawey, Mohamed A.; Trabya, A. M.: Errata: A Matrix with an application to the motion of an absorbing Markov chain. I. (English). Mathematica Slovaca, vol. 56 (2006), issue 4, pp. 483-484
• Dijk, Nico M. van; Sladký, Karel: Monotonicity and comparison results for nonnegative dynamic systems. Part I: Discrete-time case. (English). Kybernetika, vol. 42 (2006), issue 1, pp. 37-56
• Zhang, Xiao-Dong; Luo, Rong: Upper bound for the non-maximal eigenvalues of irreducible nonnegative matrices. (English). Czechoslovak Mathematical Journal, vol. 52 (2002), issue 3, pp. 537-544
• Smith, Jonathan D. H.: A class of quasigroups solving a problem of ergodic theory. (English). Commentationes Mathematicae Universitatis Carolinae, vol. 41 (2000), issue 2, pp. 409-414
• Janžura, Martin; Boček, Pavel: A method for knowledge integration. (English). Kybernetika, vol. 34 (1998), issue 1, pp. [41]-55
• Kirkland, Stephen J.; Neumann, Michael; Shader, Bryan L.: On a bound on algebraic connectivity: the case of equality. (English). Czechoslovak Mathematical Journal, vol. 48 (1998), issue 1, pp. 65-76
• El-Shehawey, Mohamed A.; Al-Matrafi, Bakheet N.: On a gambler's ruin problem. (English). Mathematica Slovaca, vol. 47 (1997), issue 4, pp. 483-488
• El-Shehawey, Mohamed A.; Trabya, A. M.: A matrix with an application to the motion of an absorbing Markov chain. I. (English). Mathematica Slovaca, vol. 46 (1996), issue 1, pp. 101-110
• Markl, Jaroslav: A graph method for Markov models solving. (English). Acta Mathematica et Informatica Universitatis Ostraviensis, vol. 1 (1993), issue 1, pp. 75-82
• Veselý, Petr: Two contributions to the theory of coefficients of ergodicity. (English). Czechoslovak Mathematical Journal, vol. 42 (1992), issue 1, pp. 73-88
• Lešanovský, Antonín: Coefficients of ergodicity generated by non-symmetrical vector norms. (English). Czechoslovak Mathematical Journal, vol. 40 (1990), issue 2, pp. 284-294
• Laušmanová, Monika: A vanishing discount limit theorem for controlled Markov chains. (English). Kybernetika, vol. 25 (1989), issue 5, pp. 366-374
• Schwarz, Štefan: A combinatorial problem arising in finite Markov chains. (English). Mathematica Slovaca, vol. 36 (1986), issue 2, pp. 199-210
• Kratochvíl, Petr; Lešanovský, Antonín: A contractive property in finite state Markov chains. (English). Czechoslovak Mathematical Journal, vol. 35 (1985), issue 3, pp. 491-509
• Kratochvíl, Petr: On convergence of homogeneous Markov chains. (English). Aplikace matematiky, vol. 28 (1983), issue 2, pp. 116-119
• Šidák, Zbyněk: Bibliography on Markov chains with a general state space. (English). Aplikace matematiky, vol. 21 (1976), issue 5, pp. 365-382
• van Kieu, Pham: A diffusion approximation in the ruin problem for a controlled Markov chain. (English). Kybernetika, vol. 10 (1974), issue 2, pp. (125)-132
• Sladký, Karel: On the set of optimal controls for Markov chains with rewards. (English). Kybernetika, vol. 10 (1974), issue 4, pp. (350)-367
• Sladký, Karel: Necessary and sufficient optimality conditions for average reward of controlled Markov chains. (English). Kybernetika, vol. 9 (1973), issue 2, pp. (124)-137
• Mandl, Petr: The Kiefer-Wolfowitz approximation method in controlled Markov chains. (English). Kybernetika, vol. 7 (1971), issue 6, pp. (436)-440
• Mandl, Petr: On the variance in controlled Markov chains. (English). Kybernetika, vol. 7 (1971), issue 1, pp. (1)-12
• Seneta, Eugene: The principle of truncations in applied probability. (English). Commentationes Mathematicae Universitatis Carolinae, vol. 9 (1968), issue 2, pp. 237-242