 Research
 Open Access
 Published:
Stabilization of company’s income modeled by a system of discrete stochastic equations
Advances in Difference Equationsvolume 2014, Article number: 289 (2014)
Abstract
The paper deals with a system of difference equations where the coefficients depend on Markov chains. The functional equations for a particular density and the moment equations for the system are derived and used in the investigation of mode stability of company’s income. An application of the results is illustrated by two models.
1 Introduction
As early as the beginning of the 20th century, it was discovered that, even in sequences of equally distributed random variables, a marginal distribution may quite naturally occur other than normal. Most of the underlying laws behind such occurrences can only be understood on the basis of the theory of Markov chains. A random process is called a Markov chain if the way it passes from one state to another depends only on the current state regardless of the states preceding it. The set of states is finite or countable. Using stochastic approach, one can investigate a number of aspects relating to a variety of phenomena in finance and economics.
In terms of the modern theory of finance [1–6], efficient ways must be found for controlling the financial resources using such categories as ‘time’, ‘profit’, and ‘risk’.
With a stochastic approach, models describing the profit of a company may be created using Markov chains. The first such financial models were developed in the second half of the 20th century [7, 8].
The paper constructs mathematical models of complex economic systems working in conditions of uncertainty. Incomplete or distorted information, too few observations, structure changing over time, stochastic nature of the impact of the external environment, these and other factors generate conditions of uncertainty for the system. The problems encountered in creating and solving mathematical models are caused by the fact that the inputoutput data type contains nonlinearities and perturbations. The paper focuses on the construction of moment equations to determine the mean value of the guaranteed profit of a company. The theoretical results are applied to two models of the profit of a company.
2 Moment equations
Let $(\mathrm{\Omega},\mathcal{F},F,\mathbb{P})$ be a filtered probability space (stochastic basis) consisting of a probability space $(\mathrm{\Omega},\mathcal{F},\mathbb{P})$ and a filtration
(for definitions see, e.g., [9]). The space Ω is called a sample space, ℱ is the set of all possible events (a σalgebra) that may occur to moment t, and ℙ is some probability measure on Ω. Such a random space plays a fundamental role in the construction of models in economics, finance etc.
On the probability space $(\mathrm{\Omega},\mathcal{F},\mathbb{P})$, we consider an initial problem formulated for the stochastic dynamic system with random coefficients in the form
where A is an $m\times m$ matrix with random elements, B is an mdimensional column vector with random elements, ${\xi}_{n}$ is the Markov chain of a finite number of states ${\theta}_{1},{\theta}_{2},\dots ,{\theta}_{q}$ with probabilities ${p}_{k}(n)=P\{{\xi}_{n}={\theta}_{k}\}$, $k=1,2,\dots ,q$, $n=1,2,\dots $ , that satisfy the system of difference equations
$p(n)={({p}_{1}(n),{p}_{2}(n),\dots ,{p}_{k}(n))}^{T}$, $\mathrm{\Pi}={({\pi}_{ks})}_{k,s=1}^{q}$ is a $q\times q$ transition matrix and $\phi :\mathrm{\Omega}\to {\mathbb{R}}^{m}$.
If the random variable ${\xi}_{n+1}$ is in state ${\theta}_{k}$, $k=1,2,\dots ,q$, and the random variable ${\xi}_{n}$ is in state ${\theta}_{s}$, $s=1,2,\dots ,q$, we denote
and assume that there exist inverse matrices ${A}_{ks}^{1}$.
The state mdimensional column vectorfunction ${x}_{n}$, $n=1,2,\dots $ , is called a solution of system (1) within the meaning of a strong solution if it satisfies (1) with initial condition (2) [10].
Our task is to derive the moment equations of system (1) to be used for determining the mode stability of the income of a company.
We define the moments of the first and second order of a solution ${x}_{n}$, $n=1,2,\dots $ , of (1) before deriving the moment equations.
In the sequel, ${\mathbb{E}}_{m}$ denotes an mdimensional Euclidean space, mdimensional row vectorfunctions ${f}_{k}(n,z)$, $n=1,2,\dots $ , $k=1,2,\dots ,q$, $z\in {\mathbb{E}}_{m}$ are the particular probability density functions of ${x}_{n}$, $n=1,2,\dots $ , determined by the formula (see in [11])
and they satisfy the following equations:
Definition 1 The vector function
where
is called moment of the first order for a solution ${x}_{n}$, $n=1,2,\dots $ , of (1). The values ${E}_{k}^{(1)}\{{x}_{n}\}$, $k=1,2,\dots ,q$, are called particular moments of the first order.
Definition 2 The matrix function
where
is called moment of the second order for a solution ${x}_{n}$, $n=1,2,\dots $ , of (1). The values ${E}_{k}^{(2)}\{{x}_{n}\}$, $k=1,2,\dots ,q$, are called particular moments of the second order.
Theorem 1 Systems of moment equations of the first or second orders for a solution ${x}_{n}$, $n=1,2,\dots $ , of (1) are of the form
respectively.
Proof Multiplying equation (5) by z and integrating them on the Euclidean space ${\mathbb{E}}_{m}$, we obtain the system
Using the substitution ${Y}_{ks}={A}_{ks}^{1}z$, integrating by parts, in regard to ${\int}_{{\mathbb{E}}_{m}}{f}_{k}(n+1,z)\phantom{\rule{0.2em}{0ex}}dz={p}_{k}(n)$, we get, as in the proof of Theorem 2 in [2], systems of moment equations (8).
In the same way, the system of moment equations (9) can be derived. This means that equation (5) is multiplied by $z{z}^{\ast}$ and integrated by parts on the Euclidean space ${\mathbb{E}}_{m}$. □
3 Model problem 1
We consider a probability space $(\mathrm{\Omega},\mathcal{F},\mathbb{P})$ with filtration $\{{\mathcal{F}}_{t}\}$ as a space of trade relations. The changes in the level of the income of a company can be modeled by using stochastic difference equations. Such a convenient mathematical model is the scalar case of initial problem (1), (2), that is,
The stochastic equation (11) describes the graph of the income of a company with the initial value of income ${x}_{0}$. Here the inhomogeneity $b({\xi}_{n+1},{\xi}_{n})$ represents the conditions in which a company works. For example, the value $b({\theta}_{k},{\theta}_{s})={b}_{ks}$, $k,s=1,2,\dots ,q$, means the transition from one state ${\theta}_{k}$ of company activities, say, a crisis, to another state ${\theta}_{s}$, say, the postcrisis situation.
The transition probabilities satisfy system (3), and moment equations (8), (9) in the scalar case take the form
where
The first or the second moments can be obtained by solving systems of difference equations (3) and (12) or (3) and (13) respectively, for example, by using a numerical method.
Example 1 The real mean value of the income can be determined in a particular case. Assume that a company, trying to overcome a crisis, may get into three possible states corresponding to the three possible methods used:

1.
salary adjustment,

2.
number of employees,

3.
credit.
Let the transition matrix have the form
In accordance with the annual report of the company, the income values under the transition from one state to another are determined by the following coefficients:
Then, given the initial values ${E}^{(1)}\{{x}_{0}\}={(0,0,0)}^{T}$ and $p(0)={(1,0,0)}^{T}$ for the first moment, we get
further,
and so on.
By using an iterative method, after a finite number of steps, the mean value of the income can be obtained. This is approximately 4.33 with a variance of 1.11.
Remark 1 The processes described by system (11) can be controlled introducing a control function ${U}_{n}$.
Let us develop the idea mentioned in the above remark. On a bounded area $G\subset {\mathbb{E}}_{m}$, we consider the following stochastic dynamic system with random coefficients:
where the vectors ${U}_{n}$ belong to the set of control U (see [12]). We define the functional
where the matrices Q, L with Markov elements are symmetric and positive definite. The functional J is called the quality criterion of control vectors ${U}_{n}$. The control function ${U}_{n}$ in the form
which minimizes the quality criterion (15) with respect to equation (11), is called the optimal control.
We denote $S({\theta}_{k})={S}_{k}$, $Q({\theta}_{k})={Q}_{k}$, $L({\theta}_{k})={L}_{k}$, $k=1,2,\dots ,q$. If we use the method developed in [13], we obtain the following.
Theorem 2 Let there exist the optimal control (16) that minimizes the quality criterion (15) with respect to equation (11). Then the matrices ${S}_{k}$ are determined by the system
where the matrices ${C}_{s}$, $k=1,2,\dots ,q$, satisfy the system of matrix equations
with known matrices ${A}_{sk}$, ${B}_{sk}$.
The theorem gives the necessary conditions for an optimal solution of system (14) making it possible to transform the problem of synthesis of the optimal control to the problem of determining the matrices ${S}_{k}$ in system (17).
4 Model problem 2
On the probability space $(\mathrm{\Omega},\mathcal{F},\mathbb{P})$, we consider an initial problem formulated for a nonhomogenous difference equation of the form
where o is an mdimensional zero vector describing the behavior of the random value ${x}_{n}$, which stands for the company income at a moment n.
Assume that a company is managed in accordance with the behavior of a Markov chain ${\xi}_{n}$ with two possible states ${\theta}_{1}$, ${\theta}_{2}$ and the transition matrix
If the random variable is in state ${\theta}_{1}$, the company makes a profit, if the random variable is in state ${\theta}_{2}$, the company suffers a loss. Let the value of the company’s profit or loss be expressed as
and the initial state be ${x}_{0}=o$. Then equations (12) take the form
If we consider the initial values
we obtain
From the first equation, it is easy to see that ${E}^{(1)}\{{x}_{n+1}\}=o$, which means that the company will be left without the expected net profit in the above conditions.
Moment of the second order ${E}^{(2)}\{{x}_{n+1}\}$ for the above conditions can be obtained from equations (13) in the form
Thence, if, say, $\lambda =0.5$, the moment of the second order is ${E}^{(2)}\{{x}_{n}\}=n{\beta}^{2}$, which means that the company’s net profit ranges according to the threesigma rule in the interval
5 Concluding remarks
While the theoretical results as such are original and valuable too, the present models confirm the practical importance of the methods devised to study discrete systems with random parameters. The construction of moment equations is a classical method and the results shown imply that its use in investigating different types of equations brings elegant results in modeling problems in the theory of finance.
References
 1.
Goodhart CAE, Tsomocos DP: The challenge of financial stability: a new model and its applications. J. Econ. 2013, 109(2):201205. 10.1007/s0071201303455
 2.
Dzhalladova IA, Michalková M, Růžičková M: Model of stabilizing of the interest rate on deposits banking system using by moment equations. Tatra Mt. Math. Publ. 2013, 54: 4559.
 3.
Diblík J, Dzhalladova IA, Michalková M, Růžičková M: Modeling of applied problems by stochastic systems and their analysis using the moment equations. Adv. Differ. Equ. 2013., 2013: Article ID 152
 4.
Elliott RJ, Kopp PE: Mathematics of Financial Markets. Springer, New York; 2005.
 5.
Felmer G, Shid A: Vvedenie v Stokhasticheskie Finansy. Diskretnoe Vremja. MTsMNO, Moscow; 2008. (in Russian)
 6.
Shirayev AN: Essential of Stochastic Finance. World Scientific, Singapore; 2004.
 7.
Hasminski RZ: Stochastic Stability of Differential Equations. Sijthoff & Noordhoff, Alphen aan den Rijn; 1980.
 8.
Øksendal B: Stochastic Differential Equations. Springer, Berlin; 1985.
 9.
Agarwal R, Cho YJ, Saadati R: A random topological structures. Abstr. Appl. Anal. 2011., 2011: Article ID 762361
 10.
Gikhman II, Skorokhod AV: Controlled Stochastic Processes. Springer, Berlin; 1979.
 11.
Krasovskii NN: On meansquare optimum stabilization at damped random perturbations. J. Appl. Math. Mech. 1961, 25: 12121227. Prikl. Mat. Meh. 25(5), 806817 (1961) 10.1016/00218928(61)900028
 12.
Åström KJ: Introduction to Stochastic Control Theory. Elsevier, Amsterdam; 1970.
 13.
Růžičková M, Dzhalladova IA: The optimization of solutions of the dynamic systems with random structure. Abstr. Appl. Anal. 2011., 2011: Article ID 486714
Acknowledgements
The first author is supported by the Operational Programme Research and Development for Innovations, No. CZ.1.05/2.1.00/03.0097 (AdMaS). The third author is supported by the Grant KEGA č. 004ŽU4/2014 of the Slovak Grant Agency.
Author information
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors contributed equally to the writing of this paper. All authors read and approved the final manuscript.
Rights and permissions
About this article
Received
Accepted
Published
DOI
Keywords
 Markov Chain
 Difference Equation
 Probability Space
 Moment Equation
 Stochastic Dynamic System