- Research
- Open Access

# Stabilization of company’s income modeled by a system of discrete stochastic equations

- Josef Diblík
^{1}, - Irada Dzhalladova
^{2}and - Miroslava Růžičková
^{3}Email author

**2014**:289

https://doi.org/10.1186/1687-1847-2014-289

© Diblík et al.; licensee Springer. 2014

**Received: **22 September 2014

**Accepted: **6 November 2014

**Published: **17 November 2014

## Abstract

The paper deals with a system of difference equations where the coefficients depend on Markov chains. The functional equations for a particular density and the moment equations for the system are derived and used in the investigation of mode stability of company’s income. An application of the results is illustrated by two models.

## Keywords

- Markov Chain
- Difference Equation
- Probability Space
- Moment Equation
- Stochastic Dynamic System

## 1 Introduction

As early as the beginning of the 20th century, it was discovered that, even in sequences of equally distributed random variables, a marginal distribution may quite naturally occur other than normal. Most of the underlying laws behind such occurrences can only be understood on the basis of the theory of Markov chains. A random process is called a Markov chain if the way it passes from one state to another depends only on the current state regardless of the states preceding it. The set of states is finite or countable. Using stochastic approach, one can investigate a number of aspects relating to a variety of phenomena in finance and economics.

In terms of the modern theory of finance [1–6], efficient ways must be found for controlling the financial resources using such categories as ‘time’, ‘profit’, and ‘risk’.

With a stochastic approach, models describing the profit of a company may be created using Markov chains. The first such financial models were developed in the second half of the 20th century [7, 8].

The paper constructs mathematical models of complex economic systems working in conditions of uncertainty. Incomplete or distorted information, too few observations, structure changing over time, stochastic nature of the impact of the external environment, these and other factors generate conditions of uncertainty for the system. The problems encountered in creating and solving mathematical models are caused by the fact that the input-output data type contains nonlinearities and perturbations. The paper focuses on the construction of moment equations to determine the mean value of the guaranteed profit of a company. The theoretical results are applied to two models of the profit of a company.

## 2 Moment equations

(for definitions see, *e.g.*, [9]). The space Ω is called a sample space, ℱ is the set of all possible events (a *σ*-algebra) that may occur to moment *t*, and ℙ is some probability measure on Ω. Such a random space plays a fundamental role in the construction of models in economics, finance *etc.*

*A*is an $m\times m$ matrix with random elements,

*B*is an

*m*-dimensional column vector with random elements, ${\xi}_{n}$ is the Markov chain of a finite number of states ${\theta}_{1},{\theta}_{2},\dots ,{\theta}_{q}$ with probabilities ${p}_{k}(n)=P\{{\xi}_{n}={\theta}_{k}\}$, $k=1,2,\dots ,q$, $n=1,2,\dots $ , that satisfy the system of difference equations

$p(n)={({p}_{1}(n),{p}_{2}(n),\dots ,{p}_{k}(n))}^{T}$, $\mathrm{\Pi}={({\pi}_{ks})}_{k,s=1}^{q}$ is a $q\times q$ transition matrix and $\phi :\mathrm{\Omega}\to {\mathbb{R}}^{m}$.

and assume that there exist inverse matrices ${A}_{ks}^{-1}$.

The state *m*-dimensional column vector-function ${x}_{n}$, $n=1,2,\dots $ , is called a solution of system (1) within the meaning of a strong solution if it satisfies (1) with initial condition (2) [10].

Our task is to derive the moment equations of system (1) to be used for determining the mode stability of the income of a company.

We define the moments of the first and second order of a solution ${x}_{n}$, $n=1,2,\dots $ , of (1) before deriving the moment equations.

*m*-dimensional Euclidean space,

*m*-dimensional row vector-functions ${f}_{k}(n,z)$, $n=1,2,\dots $ , $k=1,2,\dots ,q$, $z\in {\mathbb{E}}_{m}$ are the particular probability density functions of ${x}_{n}$, $n=1,2,\dots $ , determined by the formula (see in [11])

**Definition 1**The vector function

is called moment of the first order for a solution ${x}_{n}$, $n=1,2,\dots $ , of (1). The values ${E}_{k}^{(1)}\{{x}_{n}\}$, $k=1,2,\dots ,q$, are called particular moments of the first order.

**Definition 2**The matrix function

is called moment of the second order for a solution ${x}_{n}$, $n=1,2,\dots $ , of (1). The values ${E}_{k}^{(2)}\{{x}_{n}\}$, $k=1,2,\dots ,q$, are called particular moments of the second order.

**Theorem 1**

*Systems of moment equations of the first or second orders for a solution*${x}_{n}$, $n=1,2,\dots $ ,

*of*(1)

*are of the form*

*respectively*.

*Proof*Multiplying equation (5) by

*z*and integrating them on the Euclidean space ${\mathbb{E}}_{m}$, we obtain the system

Using the substitution ${Y}_{ks}={A}_{ks}^{-1}z$, integrating by parts, in regard to ${\int}_{{\mathbb{E}}_{m}}{f}_{k}(n+1,z)\phantom{\rule{0.2em}{0ex}}dz={p}_{k}(n)$, we get, as in the proof of Theorem 2 in [2], systems of moment equations (8).

In the same way, the system of moment equations (9) can be derived. This means that equation (5) is multiplied by $z{z}^{\ast}$ and integrated by parts on the Euclidean space ${\mathbb{E}}_{m}$. □

## 3 Model problem 1

The stochastic equation (11) describes the graph of the income of a company with the initial value of income ${x}_{0}$. Here the inhomogeneity $b({\xi}_{n+1},{\xi}_{n})$ represents the conditions in which a company works. For example, the value $b({\theta}_{k},{\theta}_{s})={b}_{ks}$, $k,s=1,2,\dots ,q$, means the transition from one state ${\theta}_{k}$ of company activities, say, a crisis, to another state ${\theta}_{s}$, say, the post-crisis situation.

The first or the second moments can be obtained by solving systems of difference equations (3) and (12) or (3) and (13) respectively, for example, by using a numerical method.

**Example 1**The real mean value of the income can be determined in a particular case. Assume that a company, trying to overcome a crisis, may get into three possible states corresponding to the three possible methods used:

- 1.
salary adjustment,

- 2.
number of employees,

- 3.
credit.

and so on.

By using an iterative method, after a finite number of steps, the mean value of the income can be obtained. This is approximately 4.33 with a variance of 1.11.

**Remark 1** The processes described by system (11) can be controlled introducing a control function ${U}_{n}$.

*U*(see [12]). We define the functional

*Q*,

*L*with Markov elements are symmetric and positive definite. The functional

*J*is called the quality criterion of control vectors ${U}_{n}$. The control function ${U}_{n}$ in the form

which minimizes the quality criterion (15) with respect to equation (11), is called the optimal control.

We denote $S({\theta}_{k})={S}_{k}$, $Q({\theta}_{k})={Q}_{k}$, $L({\theta}_{k})={L}_{k}$, $k=1,2,\dots ,q$. If we use the method developed in [13], we obtain the following.

**Theorem 2**

*Let there exist the optimal control*(16)

*that minimizes the quality criterion*(15)

*with respect to equation*(11).

*Then the matrices*${S}_{k}$

*are determined by the system*

*where the matrices*${C}_{s}$, $k=1,2,\dots ,q$,

*satisfy the system of matrix equations*

*with known matrices* ${A}_{sk}$, ${B}_{sk}$.

The theorem gives the necessary conditions for an optimal solution of system (14) making it possible to transform the problem of synthesis of the optimal control to the problem of determining the matrices ${S}_{k}$ in system (17).

## 4 Model problem 2

where *o* is an *m*-dimensional zero vector describing the behavior of the random value ${x}_{n}$, which stands for the company income at a moment *n*.

From the first equation, it is easy to see that ${E}^{(1)}\{{x}_{n+1}\}=o$, which means that the company will be left without the expected net profit in the above conditions.

## 5 Concluding remarks

While the theoretical results as such are original and valuable too, the present models confirm the practical importance of the methods devised to study discrete systems with random parameters. The construction of moment equations is a classical method and the results shown imply that its use in investigating different types of equations brings elegant results in modeling problems in the theory of finance.

## Declarations

### Acknowledgements

The first author is supported by the Operational Programme Research and Development for Innovations, No. CZ.1.05/2.1.00/03.0097 (AdMaS). The third author is supported by the Grant KEGA č. 004ŽU-4/2014 of the Slovak Grant Agency.

## Authors’ Affiliations

## References

- Goodhart CAE, Tsomocos DP: The challenge of financial stability: a new model and its applications.
*J. Econ.*2013, 109(2):201-205. 10.1007/s00712-013-0345-5View ArticleGoogle Scholar - Dzhalladova IA, Michalková M, Růžičková M: Model of stabilizing of the interest rate on deposits banking system using by moment equations.
*Tatra Mt. Math. Publ.*2013, 54: 45-59.MathSciNetMATHGoogle Scholar - Diblík J, Dzhalladova IA, Michalková M, Růžičková M: Modeling of applied problems by stochastic systems and their analysis using the moment equations.
*Adv. Differ. Equ.*2013., 2013: Article ID 152Google Scholar - Elliott RJ, Kopp PE:
*Mathematics of Financial Markets*. Springer, New York; 2005.MATHGoogle Scholar - Felmer G, Shid A:
*Vvedenie v Stokhasticheskie Finansy. Diskretnoe Vremja*. MTsMNO, Moscow; 2008. (in Russian)Google Scholar - Shirayev AN:
*Essential of Stochastic Finance*. World Scientific, Singapore; 2004.Google Scholar - Hasminski RZ:
*Stochastic Stability of Differential Equations*. Sijthoff & Noordhoff, Alphen aan den Rijn; 1980.View ArticleGoogle Scholar - Øksendal B:
*Stochastic Differential Equations*. Springer, Berlin; 1985.View ArticleMATHGoogle Scholar - Agarwal R, Cho YJ, Saadati R: A random topological structures.
*Abstr. Appl. Anal.*2011., 2011: Article ID 762361Google Scholar - Gikhman II, Skorokhod AV:
*Controlled Stochastic Processes*. Springer, Berlin; 1979.View ArticleMATHGoogle Scholar - Krasovskii NN: On mean-square optimum stabilization at damped random perturbations.
*J. Appl. Math. Mech.*1961, 25: 1212-1227. Prikl. Mat. Meh. 25(5), 806-817 (1961) 10.1016/0021-8928(61)90002-8MathSciNetView ArticleMATHGoogle Scholar - Åström KJ:
*Introduction to Stochastic Control Theory*. Elsevier, Amsterdam; 1970.MATHGoogle Scholar - Růžičková M, Dzhalladova IA: The optimization of solutions of the dynamic systems with random structure.
*Abstr. Appl. Anal.*2011., 2011: Article ID 486714Google Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.