Namespaces
Variants
Actions

Difference between revisions of "Instantaneous state"

From Encyclopedia of Mathematics
Jump to: navigation, search
(Importing text file)
 
(TeX)
Line 1: Line 1:
 +
{{TEX|done}}
 
''of a homogeneous [[Markov chain|Markov chain]] with a countable set of states''
 
''of a homogeneous [[Markov chain|Markov chain]] with a countable set of states''
  
A state (say, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/i/i051/i051280/i0512801.png" />) for which the density of the transition probability,
+
A state (say, $i$) for which the density of the transition probability,
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/i/i051/i051280/i0512802.png" /></td> </tr></table>
+
$$a_{ii}=\lim_{h\downarrow0}\frac{p_{ii}(h)-1}{h},$$
  
where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/i/i051/i051280/i0512803.png" /> is the probability of transition from <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/i/i051/i051280/i0512804.png" /> to <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/i/i051/i051280/i0512805.png" /> in time <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/i/i051/i051280/i0512806.png" />, is equal to <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/i/i051/i051280/i0512807.png" />. In the opposite case the state <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/i/i051/i051280/i0512808.png" /> is called non-instantaneous, or retarded.
+
where $p_{ii}(h)$ is the probability of transition from $i$ to $i$ in time $h$, is equal to $-\infty$. In the opposite case the state $i$ is called non-instantaneous, or retarded.
  
 
====References====
 
====References====

Revision as of 10:10, 24 August 2014

of a homogeneous Markov chain with a countable set of states

A state (say, $i$) for which the density of the transition probability,

$$a_{ii}=\lim_{h\downarrow0}\frac{p_{ii}(h)-1}{h},$$

where $p_{ii}(h)$ is the probability of transition from $i$ to $i$ in time $h$, is equal to $-\infty$. In the opposite case the state $i$ is called non-instantaneous, or retarded.

References

[1] I.I. [I.I. Gikhman] Gihman, A.V. [A.V. Skorokhod] Skorohod, "The theory of stochastic processes" , 2 , Springer (1975) (Translated from Russian)


Comments

References

[a1] D. Williams, "Diffusions, Markov processes, and martingales" , 1 , Wiley (1979)
[a2] K.L. Chung, "Markov chains with stationary transition probabilities" , Springer (1967)
[a3] E.B. Dynkin, "Markov processes" , 1 , Springer (1965) (Translated from Russian)
[a4] D. Freedman, "Brownian motion and diffusion" , Holden-Day (1971)
How to Cite This Entry:
Instantaneous state. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=Instantaneous_state&oldid=33120
This article was adapted from an original article by A.N. Shiryaev (originator), which appeared in Encyclopedia of Mathematics - ISBN 1402006098. See original article