Random dynamical system
In the mathematical field of dynamical systems, a random dynamical system is a dynamical system in which the equations of motion have an element of randomness to them. Random dynamical systems are characterized by a state space S, a set of maps from S into itself that can be thought of as the set of all possible equations of motion, and a probability distribution Q on the set that represents the random choice of map. Motion in a random dynamical system can be informally thought of as a state evolving according to a succession of maps randomly chosen according to the distribution Q.
An example of a random dynamical system is a stochastic differential equation; in this case the distribution Q is typically determined by noise terms. It consists of a base flow, the "noise", and a cocycle dynamical system on the "physical" phase space. Another example is discrete state random dynamical system; some elementary contradistinctions between Markov chain and random dynamical system descriptions of a stochastic dynamics are discussed.
Motivation 1: Solutions to a stochastic differential equation
Let be a -dimensional vector field, and let . Suppose that the solution to the stochastic differential equation
exists for all positive time and some (small) interval of negative time dependent upon , where denotes a -dimensional Wiener process (Brownian motion). Implicitly, this statement uses the classical Wiener probability space
In this context, the Wiener process is the coordinate process.
Now define a flow map or (solution operator) by
(whenever the right hand side is well-defined). Then (or, more precisely, the pair ) is a (local, left-sided) random dynamical system. The process of generating a "flow" from the solution to a stochastic differential equation leads us to study suitably defined "flows" on their own. These "flows" are random dynamical systems.
Motivation 2: Connection to Markov Chain
An i.i.d random dynamical system in the discrete space is described by a triplet .
- is the state space, .
- is a family of maps of . Each such map has a matrix representation, called deterministic transition matrix. It is a binary matrix but it has exactly one entry 1 in each row and 0s otherwise.
- is the probability measure of the -field of .
The discrete random dynamical system comes as follows,
- The system is in some state in , a map in is chosen according to the probability measure and the system moves to the state in step 1.
- Independently of previous maps, another map is chosen according to the probability measure and the system moves to the state .
- The procedure repeats.
The random variable is constructed by means of composition of independent random maps, . Clearly, is a Markov Chain.
Reversely, can, and how, a given MC be represented by the compositions of i.i.d. random transformations? Yes, it can, but not unique. The proof for existence is similar with Birkhoff–von Neumann theorem for doubly stochastic matrix.
Here is an example that illustrates the existence and non-uniqueness.
Example: If the state space and the set of the transformations expressed in terms of deterministic transition matrices. Then a Markov transition matrix can be represented by the following decomposition by the min-max algorithm,
In the meantime, another decomposition could be
- for all and ;
Suppose also that
- , the identity function on ;
- for all , .
That is, , , forms a group of measure-preserving transformation of the noise . For one-sided random dynamical systems, one would consider only positive indices ; for discrete-time random dynamical systems, one would consider only integer-valued ; in these cases, the maps would only form a commutative monoid instead of a group.
- for all , , the identity function on ;
- for (almost) all , is continuous in both and ;
- satisfies the (crude) cocycle property: for almost all ,
In the case of random dynamical systems driven by a Wiener process , the base flow would be given by
This can be read as saying that "starts the noise at time instead of time 0". Thus, the cocycle property can be read as saying that evolving the initial condition with some noise for seconds and then through seconds with the same noise (as started from the seconds mark) gives the same result as evolving through seconds with that same noise.
Attractors for random dynamical systems
The notion of an attractor for a random dynamical system is not as straightforward to define as in the deterministic case. For technical reasons, it is necessary to "rewind time", as in the definition of a pullback attractor. Moreover, the attractor is dependent upon the realisation of the noise.
- Bhattacharya, Rabi, and Mukul Majumdar. "Random dynamical systems: a review." Economic Theory 23, no. 1 (2003): 13-38., Rabi; Mukul Majumdar (2003). "Random dynamical systems: a review". Economic Theory. 23 (1): 13–38. doi:10.1007/s00199-003-0357-4.CS1 maint: multiple names: authors list (link)
- Ye, Felix X.-F.; Wang, Yue; Qian, Hong (August 2016). "Stochastic dynamics: Markov chains and random transformations". Discrete and Continuous Dynamical Systems - Series B. 21 (7): 2337–2361. doi:10.3934/dcdsb.2016050.
- Arnold, Ludwig (1998). Random Dynamical Systems. ISBN 9783540637585.
- Crauel, Hans; Debussche, Arnaud; Flandoli, Franco (1997). "Random attractors". Journal of Dynamics and Differential Equations. 9 (2): 307–341. Bibcode:1997JDDE....9..307C. doi:10.1007/BF02219225.