- Research
- Open Access

# Higher difference structure of some discrete processes

- AY Shahverdian
^{1, 2}Email author, - A Kilicman
^{3}and - RB Benosman
^{4}

**2012**:202

https://doi.org/10.1186/1687-1847-2012-202

© Shahverdian et al.; licensee Springer 2012

**Received:**20 October 2012**Accepted:**8 November 2012**Published:**26 November 2012

## Abstract

A method for analyzing discrete processes based on consideration of their higher difference structure is presented. Two kinds of processes, deterministic systems (discrete dynamical systems) and the sequences of random binary independent variables, are considered. Two main statements, computation of higher absolute differences and restoring the original by a given higher order difference image, are studied. Some applications to dynamical systems are given.

**MSC:**39B12, 39A50, 37E05.

## Keywords

- higher differences
- discrete dynamical systems
- independent random processes

## 1 Introduction

This paper presents some results on difference analysis, which is a method for studying irregular time series and orbits of discrete dynamical systems. Such an analysis, suggested in [1–3], is based on consideration of higher absolute differences taken from successive terms of a given time series or orbits of a given system. This is motivated by an observation that some natural systems (*e.g.*, the visual cortex, [4]) process the information contained in signals difference structure. The difference analysis reveals some new aspects of nonlinearity; for instance, a difference analog for Lyapunov exponent [5], used for chaos discrimination, is introduced [3].

The content of this paper is as follows. In Section 2 deterministic processes are considered, Section 3 deals with random independent binary processes. In both cases, we are interested in computation of higher order absolute differences, recovering the original by a given difference image as well as in the limiting behavior of difference processes. Section 4 contains the proofs of results presented.

## 2 Deterministic processes

This section considers higher absolute differences taken from successive terms of discrete deterministic systems. Two main problems, computation of higher differences and restoring the original, are studied. Some applications to discrete dynamical systems are given.

### 2.1 Higher absolute differences of deterministic processes

In difference analysis, a given time series or an orbit *X* is decomposed into two constituents: the sign component S and the magnitude (or height) component H. The S-component reflects the alternation in monotony (increase/decrease) of higher order absolute differences taken from successive terms of *X*. The component S does not depend on the very exact values of these differences, while the component H consists of these absolute differences and does not depend on their sign distribution. At every step (associated with the order of differences) of the decomposition process, the orbit *X* can be completely restored by first terms of *X* and the two components. Since the behavior of *X* at infinity is determined by the limiting behavior of its S- and H-components, such an analysis can also be useful in dynamical systems (see, *e.g.*, [3]).

*X*be some infinite numerical sequence

*m*th order) difference sequence, ${H}^{(m)}$ ($={H}_{1}^{(m)}$), and consider binary sequences

In this way, a given time series *X* is decomposed into two other, the sign and magnitude components ${({S}_{m})}_{m=1}^{\mathrm{\infty}}$ and ${({H}^{(m)})}_{m=1}^{\mathrm{\infty}}$. We call ${S}_{m}$ and ${H}^{(m)}$ the *m* th S- and H-components of *X*, respectively, and denote ${S}_{m}={S}_{m}(X)$, ${H}^{(m)}={H}^{(m)}(X)$, and ${H}_{m}(X)={({H}_{n}^{(m)})}_{n=1}^{\mathrm{\infty}}$.

exists, then for every ${n}^{\mathrm{\prime}}\ge n$ (for every ${m}^{\mathrm{\prime}}>m$) the limit ${H}_{{n}^{\mathrm{\prime}}}^{(\mathrm{\infty})}$ (${H}_{\mathrm{\infty}}^{({m}^{\mathrm{\prime}})}$) also exists.

The following theorem asserts that every absolute difference ${H}_{n}^{(m)}(X)$ is a linear form of the original *X* and presents a formula for its computation. The rule (5) below is a generalization of the well-known additive scheme for constructing the Pascal triangle of binomial coefficients. This theorem is a consequence of relations (2); the proof (conducted by induction) is straightforward and is omitted.

**Theorem 2.1**

*For every time series*(1)

*the*${H}_{n}^{(m)}$

*can be computed by the formula*

*where the coefficients*${k}_{m,n}^{(i)}\in \mathbb{Z}$

*are constructed recurrently*:

*for*$p\ge 1$

### 2.2 Restoring the original by difference image

At every *m* th step (associated with the order *m* of differences) of the decomposition process, the original time series can be completely restored by its first *m* entries and the two components S and H. Indeed, the following theorem provides us with analytical expressions for computation of the original *X* by the components ${S}_{1},{S}_{2},\dots ,{S}_{m}$, ${H}^{(m)}$ and first *m* terms ${f}_{1},\dots {f}_{m}$ (below, it is denoted $[{f}_{1},\dots ,{f}_{k}]={H}^{(k)}$):

**Theorem 2.2**

*Let*$m\ge 1$

*be given*, $H={({h}_{n})}_{n=1}^{\mathrm{\infty}}$

*be some infinite numerical sequence*, ${h}_{n}\ge 0$

*and*${S}_{k}={({s}_{k,n})}_{n=1}^{\mathrm{\infty}}$, ${s}_{k,n}=\pm 1$, $0\le k\le m$

*be some infinite binary sequences*.

*Let*$X={({f}_{n})}_{n=1}^{\mathrm{\infty}}$

*be defined as follows*: ${f}_{1},\dots ,{f}_{m}$

*are arbitrary and for every natural*$n\ge 1$

*where*${\sum}_{i}^{j}=0$

*if*$j<i$

*and*${B}_{n,i,p}\in \mathbb{Z}$

*are constructed recurrently*:

*for*$p\ge 1$

*Then for all*$1\le n\le m$

*the relations*

*hold*.

We note that Eq. (7) represents a countable infinite system of higher order difference equations (which are nonlinear since we deal with absolute differences) and its solution by Eq. (6) is given. The proof of this theorem is straightforward (by induction) and is omitted.

### 2.3 Application to dynamical systems

We consider the orbits of the maps *f* defined on the unit segment $I=[0,1]$ and the limiting (as the order *m* of differences tends to +∞) behavior of their difference series ${H}^{(m)}$. We claim that this behavior is mainly due to some function ℋ ($={\mathcal{H}}_{f}$) which can be determined as a solution to some difference-functional equation.

*I*and

*X*be an orbit,

*f*. Theorem 2.1 yields that ${H}^{(m)}$ is some ‘iterate polynomial’,

*n*th series ${({H}_{n}^{(m)})}_{m=1}^{\mathrm{\infty}}$. Indeed, it follows from (2) that, for $x\in {\mathcal{D}}_{f}$ and every $n\ge 1$, ${f}^{(n)}(x)$ is also found in ${\mathcal{D}}_{f}$ (

*i.e.*, ${f}^{(n)}({\mathcal{D}}_{f})\subseteq {\mathcal{D}}_{f}$ for all $n\ge 1$). Then since ${H}_{n}^{(m)}(x)={H}_{1}^{(m)}({f}^{(n)}(x))$, it follows that

The next statement presents a difference equation for computation of the limiting function ℋ and establishes the special property of such functions: once vanished, ℋ remains zero on all the further orbit of the map *f*. In the following two statements, $[a]$ denotes the entire part of number *a* (maximal integer which does not exceed *a*) and $\{a\}=a-[a]$ is its fractional part.

**Theorem 2.3**

*For functions*ℋ

*defined by Eq*. (9),

*the following statements are true*:

- (1)
*The function*ℋ*satisfies the following functional equation*:$|\mathcal{H}(x)-\mathcal{H}(f(x))|=\mathcal{H}(x).$(10) - (2)
*If for some*$x\in {\mathcal{D}}_{f}$*we have*$\mathcal{H}(x)=0$,*then*$\mathcal{H}({f}^{(n)}(x))=0$*for all*$n\ge 0$. - (3)
*If for some*$x\in {\mathcal{D}}_{f}$*we have*$\mathcal{H}(x)\ne 0$,*then there is a number**N*, $0\le N\le log[1/\mathcal{H}(x)]$*such that*$\mathcal{H}({f}^{(n)}(x))=\{\begin{array}{cc}{2}^{n}\mathcal{H}(x),\hfill & 0\le n\le N,\hfill \\ 0,\hfill & n>N.\hfill \end{array}$

The proof of this theorem is straightforward: the point (1) of theorem is a consequence of Eq. (2) and points (2) and (3) follow directly from the point (1).

Particularly, this theorem immediately implies the following.

**Corollary 2.4**

*Let*,

*for some*$x\in I$,

*the semi*-

*orbit*

*be infinite*. *Then* $\mathcal{H}({f}^{(n)}(x))=0$ *for all large enough* $n\in \mathbb{Z}$.

For instance, if *f* is such that $f(I)=I$ (*e.g.*, this can be the so-called 4-logistic map $f(x)=4x(1-x)$ or Bernoulli shift $f(x)=\{2x\}$ studied in deterministic chaos [5, 6]) and ${\mathcal{D}}_{f}=I$, then for every $x\in I$ the semi-orbit (11) is infinite and hence, by Corollary 2.4, for such *f*, ℋ is identically zero on every periodic orbit: if $x\in Per(f)$, then $\mathcal{H}({f}^{n}(x))=0$ for every $n\in \mathbb{Z}$. Particularly, it follows that if $f:I\to I$ is such that $f(I)=I$ and $Per(f)$ is dense on *I*, then the null-set $\{x\in I:{\mathcal{H}}_{f}(x)=0\}$ is also dense on *I*.

## 3 Random independent discrete processes

This section considers the higher absolute differences taken from successive terms of random independent binary sequences (see also [7]). The same two problems as in Section 2, computation of higher order absolute differences and restoring the original, are studied. When proving Theorem 3.2, we underline some connections of difference analysis with discrete models of self-organized criticality (SOC), a physics-originated theory (*e.g.*, [8, 9]) which studies the large systems of interacting microsystems.

### 3.1 Higher absolute differences of random binary processes

*ξ*, we assign the distribution of probabilities in the form $P(\xi =\lambda )=\frac{1}{2}(1+{(-1)}^{\lambda}\pi )$, where $\lambda \in \{0,1\}$ and $\pi \in (0,1)$. We denote $\pi =\pi (\xi )$ and characterize a variable

*ξ*by the corresponding number $\pi (\xi )$. We notice that since $\pi (\xi )=\pi (1-\xi )$, $\pi (\xi )$ determines a variable

*ξ*uniquely only when

*ξ*is equidistributed,

*i.e.*, $\pi (\xi )=0$. In the following, we consider the binary version ℙ of the Pascal triangle of binomial coefficients, $\mathbb{P}={\u3008{\alpha}_{i,k}\u3009}_{i,k}$ ($0\le i\le k$; $k\ge 1$), where every

*k*th line ($k\ge 1$) of ℙ is defined by relations

The following Theorem 3.1 is an analog for Theorem 2.1. To demonstrate the analogy, instead of $\pi (\xi )$, we use $\phi (\xi )=-ln\pi (\xi )$ and denote ${\phi}_{n}=\phi ({\xi}_{n})$ and ${\phi}_{n}^{(k)}=\phi ({\xi}_{n}^{(k)})$ ($=-ln\pi ({\xi}_{n}^{(k)})$).

**Theorem 3.1**

*For every process*(12), ${\phi}_{n}^{(k)}$

*can be computed by the formula*

*where the coefficients* ${\alpha}_{i,k}$ *are the terms of* *kth line of the triangle* ℙ.

### 3.2 Restoring the original by difference image

for $n=1,2,\dots $ hold. The solution to this task is given by Theorem 3.2 which is an analog for Theorem 2.2. The proof of Theorem 3.2 is conducted by involving some physics-related notions such as particles, energy, *etc.* Particularly, this allows us to demonstrate some connections of the difference analysis with a modification of some SOC-related models.

*k*th line of the triangle ℙ. We assume that such ${\alpha}_{i,k}$ are numbered in increasing order of the index

*i*: ${\alpha}_{{s}_{i},k}=1$, where $0={s}_{0}<{s}_{1}<\cdots <{s}_{q}=k$ and let us denote ${h}_{i}=k+1-{s}_{i}$. Thus, a number $q=q(k)$ and two ordered samples,

correspond to a given *k*. Equation (14) means that our task is reduced to solving some countable system of linear algebraic equations; since, for every *i* which is not contained in the sample **s** from Eq. (15), we have ${\alpha}_{i,k}=0$, the system of equations (14) coincides with the system (16) below.

In the next formulation, for a positive number *a*, $[a]$ denotes the entire part of *a* (maximal integer which does not exceed *a*), and for natural *a* and *b*, we denote $\{a/b\}=\{\begin{array}{ll}r,& r\ne 0\\ b,& r=0\end{array}$, where *r* is residual from dividing *a* by *b* (and $r=a$ if $a<b$).

**Theorem 3.2**

*Let*$k\ge 2$

*be given*, $q=q(k)$,

*and*$\mathbf{s}={({s}_{i})}_{i=0}^{q}$

*and*$\mathbf{h}={({h}_{i})}_{i=0}^{q}$

*be defined by Eq*. (15).

*Let us consider the system of linear algebraic equations*

*where*$n=1,2,\dots $

*and*${\beta}_{n}$

*are free terms*)

*and define the numbers*${\phi}_{n}$

*as follows*:

- (1)${\phi}_{1},{\phi}_{2},\dots ,{\phi}_{k}$
*are positive and arbitrary*,*and for*$1\le T\le k-{s}_{q-1}$, ${\phi}_{k+T}$*is equal to*${\phi}_{k+T}={\beta}_{T}-\sum _{i=1}^{q-1}{\phi}_{T+{s}_{i-1}};$(17) - (2)
*for*$T\ge k-{s}_{q-1}+1$, ${\phi}_{k+T}$*is equal to*${\phi}_{k+T}=\sum _{m=1}^{T}{(-1)}^{m}{\beta}_{1+[\frac{T-1}{m}]}+\sum _{i=1}^{q-1}\sum _{s=1}^{q-1}\sum _{n=1}^{[T/{h}_{s}]}{(-1)}^{[\frac{T-1-n{h}_{s}}{{h}_{i}}]}{\phi}_{1+\{\frac{T-1-n{h}_{s}}{{h}_{i}}\}}.$(18)

*Then*, *for every* $n\in \mathbb{N}$, *the sample* $({\phi}_{n+{s}_{0}},{\phi}_{n+{s}_{1}},\dots ,{\phi}_{n+{s}_{q}})$ *satisfies Eq*. (16).

It can be noticed from formulation of this theorem that the sought ${\phi}_{m}$ (whose index *m* is given as $m=n+{s}_{i}$) are such that ${\phi}_{1},{\phi}_{2},\dots ,{\phi}_{k}$ are positive and arbitrary, while for $m\ge k+1$, we have ${\phi}_{m}={\phi}_{m}({\beta}_{1},{\beta}_{2},\dots ,{\beta}_{m};{\phi}_{1},{\phi}_{2},\dots ,{\phi}_{k})$; that is, the above-mentioned restored process ξ is not unique but depends on *k* arbitrary positive numerical parameters.

To prove Theorem 3.2, we use the following physics-related model, which can be treated as a modification of some lattice models (*e.g.*, the BTW-model, [9]) of SOC. Let us describe the model that we use. Let, for $k\ge 2$, ${\mathbb{L}}_{k}=[1,k]\times [1,k]$ be a lattice from ${\mathbb{N}}^{2}$. At every moment of discrete time $t=1,2,\dots $ at the vertices of ${\mathbb{L}}_{k}$, which are found above the diagonal *L* connecting the vertices $(1,1)$ and $(k,k)$, some material particles with positive or negative mass (or charge) are situated. Each particle performs uniform rectilinear motion with the unit speed on the vertical segments ${L}_{i}$ connecting the vertices $({s}_{i},{s}_{i})$ and $({s}_{i},k)$ ($1\le i\le q$) of ${\mathbb{L}}_{k}$. At the (initial) moment $t=1$, all the particles are found on *L* and possess the unit mass. Each moment *t*, when a number (=*p*) of particles reach simultaneously the upper side $\{(k,i):1\le i\le k\}$ of the lattice (one can see that such particles should possess the same mass *m*), these particles disappear, and at the next moment $t+1$, at every position on *L* a new particle of the mass $-pm$ emerges (and the motion of particles continues). In SOC terminology, the *p* particles hit the threshold (the upper side of the square ${\mathbb{L}}_{k}$), and an avalanche of intensity *p* at the moment *t* in the system *S* of the moving particles occurs.

*y*, $1\le y\le k$. Our task related to the above-presented model is to compute the potential energy

of the system *S* of particles on ${\mathbb{L}}_{k}$ for every moment *t*; here, ${y}_{i,s}$ and ${m}_{i,s}$ denote the *y*-coordinate and mass of the particle which at the moment *t* is found at the vertex $(i,s)\in {\mathbb{L}}_{k}$. The proof of Theorem 3.2 is based on the following lemma.

**Lemma 3.3**

*For every*$t=1,2,\dots $ ,

*the total*(

*potential*)

*energy of the system*

*S*

*can be computed by the formula*

## 4 Proof of results

*Proof of Theorem 3.1*Let $m\ge 2$, $\mathbf{x}=({x}_{1},{x}_{2},\dots ,{x}_{m})\in {\mathbb{R}}^{m}$, and we consider the polynomials

*m*. If for $\lambda \in \{0,1\}$ one considers the polynomials (the sum of binary variables is understood as the sum by $mod(2)$)

(it is assumed that ${x}_{i}\ne -1$) holds.

Now, by applying Eq. (22), one obtains Eq. (13). Theorem 3.1 is proved. □

*Proof of Lemma 3.3*For the case of a single particle with the (initial) mass equal to −1 moving on a vertical segment ${L}_{i}$ connecting the vertices $({s}_{i},{s}_{i})$ and $({s}_{i},k)$ ($1\le i\le q$) of ${\mathbb{L}}_{k}$, one can compute that

*t*, the energy of a single particle moving on ${L}_{i}$ is equal to

*t*emerges if and only if

*t*is of the form $t=n{h}_{s}+1$ (for some $n\ge 1$ and some $1\le s\le q-1$). For particles that emerged as a result of attainment of the threshold during the motion on ${L}_{i}$, the coordinate and mass are computed by (23); for particles that emerged on ${L}_{i}$ as a result of attainment of the threshold during the motion on some ${L}_{s}$, $s\ne i$, the coordinate and mass are computed by the same formula (23) but in a ‘shifted’ time: $t\to t-n{h}_{s}$. Therefore, for the total energy ${E}^{(i)}$ of the particles situated on a given vertical segment ${L}_{i}$, one obtains

*t*, the total energy of all the particles in the system

*S*is equal to

which due to Eq. (24) coincides with Eq. (20). Lemma 3.3 is proved. □

*Proof of Theorem 3.2*Since ${s}_{q}=k$, Eq. (16) can be re-written as

One can see that (27) coincides with the point (1) of the theorem, and this point of the theorem is proved.

*cf.*Eq. (27)), we associate a particle which is found on

*m*th vertical segment ${L}_{m}$ of length ${h}_{m}$ in the upper triangle of ${\mathbb{L}}_{k}$ (and if

*m*is fixed, the index

*n*enumerates a particle’s position on this segment). Equations (27) and (28) and the substitution method assign the following dynamics of index $p+1+{s}_{m}$ (and the corresponding particles) with respect to variable

*p*: if this index does not exceed

*k*(that is, the corresponding particle is found in the lattice ${\mathbb{L}}_{k}$) then

*p*increases, and if in some equation from the system (28) it appears that for some

*p*and

*m*the inequality $p+1+{s}_{m}\ge k+1$ holds, then the variable ${\phi}_{p+1+{s}_{m}}$ in this equation is replaced (according to the corresponding equation in (27)) by the sum

In terms of the lattice model, the inequality $p+1+{s}_{m}\ge k+1$ is interpreted as the threshold attainment and the substitution of ${\phi}_{p+1+{s}_{m}}$ is interpreted as an event of emergence of $q-1$ new particles on each of $q-1$ positions of the diagonal *L*. One can see that if this variable substitution procedure is sequently applied to all the equations in the system (28), we obtain the above-defined lattice model of moving particles. Then, by applying Lemma 3.3 (where the time variable *t* coincides with the variable *T* in Eq. (28)) and assuming that the potential *U* (Section 3.2) is assigned as $U(y)={\phi}_{1+y}$, we obtain the sought Eq. (18). Theorem 3.2 is proved. □

## Declarations

### Acknowledgements

Authors thank the editing group for corrections in the linguistics of the manuscript.

## Authors’ Affiliations

## References

- Shahverdian AY, Apkarian AV: On irregular behavior of neuron spike trains.
*Fractals*1999, 7: 93–103. 10.1142/S0218348X99000116View ArticleMATHGoogle Scholar - Shahverdian AY: A finite-difference method for analyzing one-dimensional nonlinear systems.
*Fractals*2000, 8: 49–65.MathSciNetMATHGoogle Scholar - Shahverdian AY, Apkarian AV: A difference characteristic for one-dimensional nonlinear systems.
*Commun. Nonlinear Sci. Numer. Simul.*2007, 12: 233–242. 10.1016/j.cnsns.2005.02.004MathSciNetView ArticleMATHGoogle Scholar - Miller KD 3. In
*Models of Neural Networks*. Edited by: Domany E, Hemmen JL, Schulten K. Springer, New York; 1996.Google Scholar - Schuster HG:
*Deterministic Chaos*. Physik-Verlag, Weinheim; 1984.MATHGoogle Scholar - Sharkovsky AN, Maisterenko YL, Romanenko EY:
*Difference Equations and Applications*. Nauka, Kiev; 1986.Google Scholar - Shahverdian AY: Minimal Lie algebra, fine limits, and dynamical systems.
*Reports of Armenian Natl. Acad. Sci.*2012, 112: 160–169.MathSciNetGoogle Scholar - Shahverdian AY, Apkarian AV: Avalanches in networks of weakly coupled phase-shifting rotators.
*Commun. Math. Sci.*2008, 6: 217–234.MathSciNetView ArticleMATHGoogle Scholar - Bak P, Tang C, Wiesenfeld K:Self-organized criticality: an explanation of $1/f$ noise.
*Phys. Rev. Lett.*1987, 59: 381–384. 10.1103/PhysRevLett.59.381MathSciNetView ArticleGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.