 Research
 Open Access
 Published:
Ordered dynamics in biased and cooperative Boolean networks
Advances in Difference Equations volume 2013, Article number: 313 (2013)
Abstract
This paper contributes to the theoretical analysis of the qualitative behavior of two types of Boolean networks: biased and cooperative ones. A Boolean network is biased if at least a specified fraction of its regulatory functions returns one Boolean value more often than the other and is cooperative if there are no negative interactions between the variables. We prove nontrivial upper bounds on the maximum length of periodic orbits in such networks under the assumption that the maximum number of inputs and outputs per node is a fixed constant r. For the case of ndimensional networks with $r=2$ in which only AND and OR are allowed, we find an upper bound of ${10}^{n/4}$, which is asymptotically optimal in view of previously published counterexamples. The theoretical results are supplemented by simulations of the generic behavior of cooperative networks which indicate that for large indegrees, trajectories tend to converge rapidly towards a steady state or a small periodic orbit. The latter starkly contrasts with the behavior of random arbitrary Boolean networks.
MSC: 05A15, 06A07, 34C12, 39A33, 94C10, 92C42.
1 Introduction
Mathematical models of biological problems have become increasingly sophisticated with the advent of new quantitative techniques. Models involving dozens of proteins at the cell level abound in the literature [1, 2], mostly created using continuous methods. An interesting counterpart to continuous systems are Boolean networks, characterized by discrete time dynamics and the existence of only two possible states (0 and 1) for each variable at any given time [3]. In the face of parameter uncertainty, modeling using Boolean networks can produce qualitative predictions at the right level of detail for many applications.
This paper continues a line of theoretical research exploring the qualitative behavior of socalled cooperative Boolean networks. This concept corresponds to systems that have exclusively positive interactions among their variables, and in particular are monotone, which means that they have only positive feedback loops. Such networks have been proposed as important tools for gaining insight into the dynamics of gene regulatory and other biological networks [4]. In the case of systems with at most two inputs for each variable, a cooperative Boolean network can only have constant, AND, OR and COPY regulatory functions. The continuous counterpart of this definition has been studied extensively [5], and under mild conditions the generic trajectory of a continuous cooperative system is guaranteed to converge towards the set of equilibria.
Much of the literature on the dynamics of Boolean networks has focused on the study of socalled random Boolean networks or RBNs, where an ndimensional Boolean network is randomly drawn from the class of all such networks with a maximum of r inputs per node. For $r>2$, the trajectory of a randomly chosen initial state tends to reach a periodic orbit whose size scales exponentially in n. Such long orbits are considered a hallmark of chaotic dynamics. Another hallmark of chaotic dynamics is sensitivity to initial conditions. This can be conceptualized in a variety of ways, for example, in terms of pinstability, as defined at the end of Section 2. A third hallmark of chaos are relatively few or no eventually frozen nodes, that is, nodes whose state will change only finitely often during the trajectory. These hallmarks usually, but not always, go together. It is a matter of judgement which hallmarks are deemed necessary for considering the dynamics truly chaotic; see [6] for examples and further discussion on this point. In terms of these hallmarks, the dynamics of RBNs tends to become, on average, more chaotic as r is increased or if the average bias of the regulatory functions, defined as the difference between 0.5 and the proportion of input vectors on which it takes the Boolean value 1, decreases. For surveys of these and related results, see [7–9].
In Section 6 we briefly explore the analogue for cooperative Boolean networks. That is, for $r\in \{2,3,4,5\}$ we simulate the trajectories of randomly chosen initial states in Boolean networks that are randomly chosen from the class of all cooperative Boolean networks with at most r inputs per node. We find that for $r>3$ trajectories tend to reach a steady state or a very small periodic orbit after a few steps, and this pattern appears to be stronger for larger r and n. We also give an argument in support of a conjecture that if there is no restriction on the number of inputs, for sufficiently large n, the vast majority of the trajectories will reach either of the steadystate vectors $(0,\dots ,0)$ or $(1,\dots ,1)$. Thus, on average, random cooperative Boolean networks tend to have much shorter periodic orbits than corresponding RBNs, and in contrast to the latter, their dynamics appears to become less chaotic, at least in terms of lengths of periodic orbits that are reached from random initial conditions and the proportion of eventually frozen nodes, as the number r of allowed inputs per node increases.
These observations about average behavior naturally lead to the question whether there exist provable and nontrivial upper bounds on the length of periodic orbits, or at least on the median length of periodic orbits, that will be reached from randomly drawn initial conditions. Since the state space of an ndimensional Boolean network has size ${2}^{n}$, a bound might be considered nontrivial if it does not exceed ${c}^{n}$ for some constant $c<2$.
If only the maximal number of inputs and outputs per node is restricted, even to 2, then no such bound can be derived; nice examples are already given in [10, 11]. On the other hand, very stringent upper bounds can be derived for some very special classes of networks, such as the XOR Boolean networks [12, 13], or the class of networks that are allowed to use only ANDoperators or ORoperators, but not both [14].
For cooperative Boolean networks, the situation is more subtle. The maximum possible size of any periodic orbit in such networks is known to be $\left(\genfrac{}{}{0ex}{}{n}{\lfloor n\rfloor}\right)$, which by Stirling’s formula scales like $\frac{{2}^{n+1}}{\sqrt{\pi n}}$, faster than ${c}^{n}$ for any $c<2$ [4, 15, 16]. It has previously been shown that if in addition to requiring cooperativity we restrict the maximum number r of inputs and the number of outputs per node, then nontrivial upper bounds on the (maximal or even median) lengths of periodic orbits still do not exist, even for $r=2$ (see Theorem 1 below, which summarizes some results from [6, 17–19]). However, for $c>{10}^{n/4}$, the constructions used in the proof of this theorem give systems in which the vast majority of variables take just one input, that is, their regulatory function is COPY. Note that while COPY is an unbiased function, both AND and OR are biased. For example, binary AND returns 1 for only one quarter of its inputs. In other words, for every $0<\alpha <1$, most constructions used for the proof of Theorem 1 give Boolean systems in which a proportion of more than $(1\alpha )$ of all regulatory functions are unbiased.
In contrast, suitable assumptions on the amount of bias do imply nontrivial upper bounds on the possible lengths of periodic orbits. Our main result, Theorem 2, shows that upper bounds of the form ${c}^{n}$ for some $c<2$ on the lengths of periodic orbits exist under the assumption of fixed bounds on the minimal proportion of biased regulatory functions and the maximal number of inputs and outputs per node. In particular, this result applies to cooperative Boolean networks with a fixed minimal proportion of binary AND or binary OR regulatory functions. By Theorem 1(ii), an upper bound on the number of inputs alone is not sufficient in this type of result. For $r=2$, if the proportion of biased regulatory functions is 1, then we can take $c={10}^{1/4}$, which is optimal in view of Theorem 1(iii).
Even more stringent bounds apply in some cases if we additionally require a certain amount of sensitivity to initial conditions. Theorem 4 gives upper bounds for the case when all regulatory functions take exactly two inputs and are biased. It implies upper bounds on the lengths of the form ${c}^{n}$ for any $c>\sqrt{3}$ in systems of this form that are punstable for p sufficiently close to 1. By Theorem 3.10 of [6], the latter bound is asymptotically optimal. Note that in contrast to Theorem 2, no upper bound on the number of outputs per node is required in Theorem 4.
Preliminary versions of the proofs given in Sections 35 were posted in the preprint [17]. One purpose of this paper is to make streamlined and more easily readable versions of these arguments available in peerreviewed journal form. The material in Section 6 is entirely new.
2 Definitions
An ndimensional Boolean network $(g,\mathrm{\Pi})$ consists of a state space $\mathrm{\Pi}={\{0,1\}}^{n}$, together with a time evolution map $g:\mathrm{\Pi}\to \mathrm{\Pi}$. Each individual component ${g}_{k}:\mathrm{\Pi}\to \{0,1\}$ is called the k th regulatory function, and a trajectory of the system is a function $s:\mathbb{N}\to \mathrm{\Pi}$ such that $s(t+1)=g(s(t))$ for every $t\in \mathbb{N}$. Since the state space is finite, each trajectory must eventually become periodic. The set of states in the periodic part of the trajectory will be called a periodic orbit. Periodic orbits that are reached from a given initial condition are often called attractors or limit cycles of the trajectory in the literature. The basin of attraction of a given periodic orbit is the set of all initial conditions from which the orbit is reached.
Define the partial order ≤ on Π by $x\le y$ if ${x}_{i}\le {y}_{i}$ for every i. A regulatory function ${g}_{k}$ is cooperative if $x\le y$ implies ${g}_{k}(x)\le {g}_{k}(y)$. A Boolean network is cooperative if each of its regulatory functions is cooperative, i.e., if $x\le y$ implies $g(x)\le g(y)$. An equivalent definition can be obtained by requiring that each regulatory function can be written as a composition of Boolean functions that use only the operators AND and OR with one or more inputs. Since the negation operator is not needed, cooperative Boolean networks are exactly the ones without negative interactions.
We define a $(b,r)$Boolean network as a system in which each regulatory function ${g}_{k}$ actually depends on at most r inputs, and each variable has at most b outputs (i.e., it affects the dynamics of at most b other variables). If $r=2$, we call the system quadratic; a $(2,2)$system is called biquadratic. A regulatory function that depends on only one variable is called monic; a nonmonic quadratic regulatory function is called strictly quadratic. A Boolean network with only quadratic regulatory functions will be called a strictly quadratic network. Notice that in a strictly quadratic, biquadratic network every variable must have exactly two inputs and two outputs.
An ndimensional Boolean network is said to be cchaotic, for $c<2$, if it has a periodic orbit of length at least ${c}^{n}$. If a periodic orbit of this length is reached from a proportion of at least p initial conditions, then the system is called pcchaotic.
The bias Λ of a regulatory function ${g}_{k}$ is the fraction of input vectors for which the function outputs 1. If $\mathrm{\Lambda}=0.5$, we say that ${g}_{k}$ is unbiased; if $\mathrm{\Lambda}\ne 0.5$, we say that ${g}_{k}$ is biased. For $0<\alpha <1$, we say that a Boolean system is αbiased if a proportion of at least α of its regulatory functions consists of biased functions. Note that this last definition neither distinguishes between bias towards 0 or 1 nor all by itself implies how strong the bias is.
A Boolean system is punstable if a random singlebit flip in a randomly chosen initial state moves the trajectory into the basin of attraction of a different periodic orbit with probability at least p. Let us call a Boolean system p1unstable if a random singlebit flip in a randomly chosen initial state results in a different state after one updating step with probability at least p (even if the new and old trajectories might merge after several updating steps). Thus every punstable Boolean system must be p1unstable, but not vice versa.
3 Bounds on the length of periodic orbits
For easier reference, let us quote the following result.
Theorem 1 Let c, ${c}_{1}$, p be constants with $0<p<1<c<2$ and $1<{c}_{1}<{10}^{1/4}$. Then, for all sufficiently large n, there exist ndimensional cooperative Boolean networks that are, respectively:

(i)
biquadratic and pcchaotic,

(ii)
strictly quadratic and pcchaotic,

(iii)
strictly quadratic, biquadratic and p${c}_{1}$chaotic.
Versions for cchaos instead of pcchaos were proved in [17, 18]; point (i) in the form quoted here was proved in [19]; point (ii) in the form quoted here was proved in [6], and (iii) as quoted here is an easy consequence of the constructions in [17, 19]. Theorem 1 sets the stage for the main result of this paper.
Theorem 2 Let $1\ge \alpha >0$, and let b, r be positive integers. Then there exists a positive constant $c(\alpha ,b,r)<2$ such that for every $c>c(\alpha ,b,r)$ and sufficiently large n, there is no cchaotic, ndimensional, αbiased $(b,r)$Boolean system. In particular, for every $c>c(\alpha ,2,r)$ and sufficiently large n, every cchaotic, ndimensional cooperative $(2,r)$Boolean system uses COPY for more than $(1\alpha )n$ of its regulatory functions.
Proof We will prove only the first part of the theorem; the second part then follows from the observation that the only nonconstant cooperative unbiased Boolean function that takes at most two inputs is the COPY function.
Fix α, b, r as in the assumptions, and let $(\mathrm{\Pi},g)$ be an ndimensional $(b,r)$Boolean system. Assume that at least αn of the regulatory functions ${g}_{k}$ are biased.
Let $\mathcal{S}=({s}^{\ell}:\phantom{\rule{0.2em}{0ex}}\ell \in [L])$ be a sequence of (not necessarily pairwise distinct) elements of $\mathrm{\Pi}={\{0,1\}}^{n}$. If the elements of happen to be pairwise distinct, then we will speak of being a subset of Π. Let $i\in [n]$ and consider the ratio
More generally, let $v\in [n]$ and $\sigma :[v]\to \{0,1\}$. For velement subsets $I=\{{i}_{1},\dots ,{i}_{v}\}$ of $[n]$ with ${i}_{1}<\cdots <{i}_{v}$, we define ratios ${\xi}_{I}^{\sigma}(\mathcal{S})$ as follows:
Define
One can think of ${\zeta}_{I}^{\ast}(\mathcal{S})\ge 0$ as a measure of the bias of the sequence on the set I. Notice that ${\zeta}_{I}^{\ast}(\mathcal{S})=0$ implies ${\zeta}_{J}^{\ast}(\mathcal{S})=0$ for all nonempty subsets J of I, and in particular that ${\zeta}_{i}(\mathcal{S})=0.5$ for all $i\in I$. □
If is randomly chosen, then for i, I as above the expected values are $E({\zeta}_{i}(\mathcal{S}))=0.5$ and $E({\xi}_{I}^{\sigma}(\mathcal{S}))={2}^{I}$. Thus if is sufficiently large, one should be able to choose a subset ${\mathcal{S}}^{\ast}\subseteq \mathcal{S}$ with ${\zeta}_{i}({\mathcal{S}}^{\ast})=0.5$, ${\zeta}_{I}^{\ast}({\mathcal{S}}^{\ast})=0$ and $\frac{{\mathcal{S}}^{\ast}}{\mathcal{S}}$ arbitrarily close to 1. The following lemma shows that periodic orbits in $(\mathrm{\Pi},g)$ are far from random in this respect.
Lemma 1 There exists $\tau >0$ such that for all $(\mathrm{\Pi},g)$ as above, all biased ${g}_{k}$, all periodic orbits of $(\mathrm{\Pi},g)$ and all subsets ${\mathcal{S}}^{\ast}$ with ${\mathcal{S}}^{\ast}\ge (1\tau )\mathcal{S}$, it holds that ${\zeta}_{I}^{\ast}({\mathcal{S}}^{\ast})\ne 0$ for $I=\{k\}\cup dom({g}_{k})$.
Proof Let $\epsilon >0$ be such that for each of the finitely many biased Boolean functions with domain $\subseteq {\{0,1\}}^{r}$, we have $\mathrm{\Lambda}0.5\ge \epsilon $. Let $\tau >0$ be small enough that $(1\tau )\epsilon \frac{3\tau}{2}=\epsilon \tau (\epsilon \frac{3}{2})>0$. Choose ${g}_{k}$ as in the assumption and assume wlog that $\mathrm{\Lambda}\ge 0.5+\epsilon $; the proof in the case when $\mathrm{\Lambda}\le 0.5\epsilon $ is symmetric. Let J be the domain of ${g}_{k}$, and let $I=\{k\}\cup J$.
Consider a subset ${\mathcal{S}}^{\ast}$ of a periodic orbit with ${\mathcal{S}}^{\ast}\ge (1\tau )\mathcal{S}$. As we mentioned in the discussion that follows (1), if ${\zeta}_{J}^{\ast}({\mathcal{S}}^{\ast})\ne 0$, then also ${\zeta}_{I}^{\ast}({\mathcal{S}}^{\ast})\ne 0$ and there is nothing to prove. So assume that ${\zeta}_{J}^{\ast}({\mathcal{S}}^{\ast})=0$. Then all possible input vectors for ${g}_{k}$ appear in exactly equal proportion in ${S}^{\ast}$, and it follows that $\{s\in {\mathcal{S}}^{\ast}:{g}_{k}(s)=1\}\ge \mathrm{\Lambda}{\mathcal{S}}^{\ast}\ge (1\tau )\mathcal{S}\mathrm{\Lambda}$. The following inequalities show that in this case ${\zeta}_{k}({\mathcal{S}}^{\ast})>0.5$, which implies ${\zeta}_{I}^{\ast}({\mathcal{S}}^{\ast})\ne 0$.
and the inequality ${\zeta}_{\{k\}}^{\ast}>0.5$ follows. This in particular implies ${\zeta}_{I}^{\ast}({\mathcal{S}}^{\ast})\ne 0$. □
Let $\beta ,\tau >0$, let $\mathcal{S}\subseteq {\{0,1\}}^{n}$, and let D be a family of pairwise disjoint subsets $I\subset [n]$ of size $1\le I\le r+1$ each with $D\ge \beta n$. We say that is βτbalanced for D if there exist $I\in D$ and ${\mathcal{S}}^{\ast}\subseteq \mathcal{S}$ with ${\mathcal{S}}^{\ast}\ge (1\tau )\mathcal{S}$ such that ${\zeta}_{I}^{\ast}(\mathcal{S})=0$, and that is βτbalanced if it is βτbalanced for every such D.
Lemma 2 There exists a constant $\beta >0$ such that for τ as in Lemma 1, no periodic orbit of $(\mathrm{\Pi},g)$ can be βτbalanced.
Proof For each $k\in [n]$, let ${I}_{k}=\{k\}\cup dom({g}_{k})$. Since $(\mathrm{\Pi},g)$ is a $(b,r)$Boolean system, for each such ${I}_{k}$ there exist at most $r+b(r1)$ other ${I}_{\ell}$ with ${I}_{k}\cap {I}_{\ell}\ne \mathrm{\varnothing}$. A recursive construction allows us to find $\alpha n/(r+b(r1)+1)$ pairwise disjoint sets ${I}_{k}$ corresponding to biased functions ${g}_{k}$. That is, for $\beta :=\frac{\alpha}{r+b(r1)+1}$, there exists a family D of pairwise disjoint subsets $I\subset [n]$ of size $1\le I\le r+1$ each, with $D\ge \beta n$, such that each set in D is of the form ${I}_{k}$ for some biased ${g}_{k}$. By Lemma 1, this family witnesses that no periodic orbit of $(\mathrm{\Pi},g)$ can be βτbalanced. □
Now Theorem 2 becomes a consequence of the following result.
Lemma 3 Let $1>\beta ,\tau >0$. Then there exists a constant $c<2$ such that for sufficiently large n, every subset of ${\{0,1\}}^{[n]}$ of size $\ge {c}^{n}$ is βτbalanced.
Proof Let β, τ be as in the assumptions and assume throughout this argument that n is a sufficiently large positive integer. Let $\epsilon ={2}^{r2}\tau $. Consider an arbitrary family D of pairwise disjoint subsets I of $[n]$ with $D\ge \beta n$ and $1\le I\le r+1$ for each $I\in D$.
The proof proceeds in three stages. First we will define, for $1<c<2$, random variables ${\eta}_{c}$. Next we will show that if there exists any subset ${\mathcal{S}}^{+}\subseteq {\{0,1\}}^{n}$ of size ${c}^{n}$ that is not βτbalanced for D, then
In the third stage we will complete the proof by showing that for c sufficiently close to 2, inequality (2) fails.
Stage 1: Defining ${\eta}_{c}$
Fix c with $1<c<2$ and consider the space of all sequences $\mathcal{S}=({s}^{\ell}:\ell \in [L])$ of randomly and independently (with replacement) chosen states in ${\{0,1\}}^{n}$ of length $L={c}^{n}$.
Consider $I=\{{i}_{1},\dots ,{i}_{v}\}\in D$ with ${i}_{1}<\cdots <{i}_{v}$ and a fixed $\sigma \in {\{0,1\}}^{[v]}$. Note that $v\in [r+1]$. We will treat ${\xi}_{I}^{\sigma}={\xi}_{I}^{\sigma}(\mathcal{S})$ and ${\zeta}_{I}^{\ast}={\zeta}_{I}^{\ast}(\mathcal{S})$ as random variables and usually suppress their dependence on in our notation. We define
Stage 2: Nonbalanced sets imply (2)
Consider the following procedure for randomly drawing a subset ${\mathcal{S}}^{\u2020}$ of ${\{0,1\}}^{n}$ of size ${c}^{n}$: First draw a sequence as in Stage 1. Then the set ${\mathcal{S}}_{\mathrm{red}}=\{{s}^{\ell}:\ell \in [L]\}$ associated to the sequence has size ${c}^{n}N$, where $N=N(\mathcal{S})$ is a random variable that represents the number of ${s}^{\ell}$ in that duplicate an earlier term in the sequence. Form ${\mathcal{S}}^{\u2020}={\mathcal{S}}^{\u2020}(\mathcal{S})$ by adding a randomly chosen subset of ${\{0,1\}}^{n}\mathrm{\setminus}{\mathcal{S}}_{\mathrm{red}}$ of size N to ${\mathcal{S}}_{\mathrm{red}}$. By symmetry, this gives the uniform distribution, and moreover, for any given M with $0\le M<{c}^{n}$, the conditional probability of any potential outcome ${\mathcal{S}}^{+}$ is still uniform, that is,
The expected value of N can be estimated as
In particular, we can assume $E(N)<\frac{\epsilon}{2}{c}^{n}$. Now it follows from (4) and Markov’s inequality
that we can assume
Now assume that there is any subset ${\mathcal{S}}^{+}\subset {\{0,1\}}^{n}$ of size ${c}^{n}$ that is not βτbalanced for D, and suppose that exists for which $N(\mathcal{S})\le \epsilon {c}^{n}$ and ${\mathcal{S}}^{\u2020}(\mathcal{S})={\mathcal{S}}^{+}$. Consider $I=\{{i}_{1},\dots ,{i}_{v}\}\in D$. If ${\zeta}_{I}^{\ast}(\mathcal{S})<\epsilon $, then ${\zeta}_{I}^{\ast}({\mathcal{S}}^{+})<2\epsilon $, and for each $\sigma :[v]\to \{0,1\}$, we can find ${S}_{\sigma}^{+}\subset {\mathcal{S}}^{+}$ of size $({2}^{v}2\epsilon ){c}^{n}$ such that ${s}_{{i}_{u}}=\sigma (u)$ for each $u\in [v]$. These sets are pairwise disjoint, and their union ${\mathcal{S}}^{\ast}$ satisfies ${\zeta}_{I}^{\ast}({\mathcal{S}}^{\ast})=0$. Moreover, ${\mathcal{S}}^{+}\mathrm{\setminus}{\mathcal{S}}^{\ast}\le {2}^{r+2}\epsilon {c}^{n}=\tau {c}^{n}$. This would contradict the assumption that ${\mathcal{S}}^{+}$ was not βτbalanced for D. Thus we must have ${\eta}_{c}\ge \epsilon $, that is, $P({\eta}_{c}\ge \epsilon \mid {\mathcal{S}}^{\u2020}={\mathcal{S}}^{+}\phantom{\rule{0.25em}{0ex}}\mathrm{\&}\phantom{\rule{0.25em}{0ex}}N\le \epsilon {c}^{n})=1$. Now
and (2) follows from (3) and (5).
Stage 3: Inequality (2) fails for sufficiently large c
Consider $I\in D$ with $I=v$ and $\sigma :[v]\to \{0,1\}$. Recall that $E({\xi}_{I}^{\sigma})={2}^{v}$. We want to estimate the probability $P({2}^{v}{\xi}_{I}^{\sigma}\ge \epsilon )$. Note that ${\xi}_{I}^{\sigma}$ is the mean of ${c}^{n}$ independent random variables that take values in $\{0,1\}$. Thus Hoeffding’s inequality [20] applies, and we get
where $\lambda ={e}^{2{\epsilon}^{2}}<1$, which in turn implies that $P({\zeta}_{I}^{\ast}\ge \epsilon )\le {2}^{v}{\lambda}^{{c}^{n}}$. Since the random variables ${\zeta}_{I}^{\ast}$ for $I\in D$ are independent, it follows that
By Stirling’s formula, the number of subsets of Π of size ${c}^{n}$ satisfies
Thus for $c>2{\lambda}^{\beta}$ and n sufficiently large, estimates (6) and (7) imply
as required. □
4 More stringent bounds for the case $b=r=2$, $\alpha =1$
Let $c(\alpha ,b,r)$ denote the smallest real number for which the conclusion of Theorem 2 holds in the class of cooperative Boolean networks. Theorem 2 states that $2c(\alpha ,b,r)>0$, but gives no estimates of the magnitude of the difference. Some lower bounds for the differences were extracted from the proof of the theorem in Appendix C of preprint [17]; they appear to substantially underestimate the actual difference. For example, the proof of Theorem 2 shows only that $c(1,2,2)\le 1.9959$. On the other hand, Corollary 19 of the preprint [17] gives an upper bound of $c(\alpha ,2,2)\le {10}^{(2\alpha )/4}$, which is more stringent if α is sufficiently close to 1. In particular, since for $c>c(1,2,2)$ no strictly quadratic, biquadratic Boolean network can be cchaotic, this result implies together with Theorem 1(iii) that the latter estimate is optimal in this case and $c(1,2,2)={10}^{1/4}\approx 1.7783$.
We will prove this result here only for the special case of cooperative systems, which makes the argument more transparent. The proof for the general case given in [17] uses essentially the same ideas.
Theorem 3 Consider a strictly quadratic, biquadratic, cooperative Boolean system $(\mathrm{\Pi},f)$ of dimension n with a periodic orbit of size ${c}^{n}$. Then $c\le {10}^{1/4}$.
Proof Let $(\mathrm{\Pi},f)$ be as in the assumption, with $({f}_{1},\dots ,{f}_{n})$. Call a subset $I\subseteq [n]$ closed if each ${f}_{i}$ for $i\in I$ takes inputs only from I, and call I minimal closed if no proper subset of I is closed. Given the constraints on the indegree and outdegree of each node, it follows that all in and outdegrees are equal to two, and that all outputs of elements from a minimal closed set I are also inside I. Therefore $[n]$ is the union of pairwise disjoint minimal closed sets ${I}_{\ell}$, for $\ell \in [L]$, with $2\le {I}_{\ell}\le n$ for all ℓ. Let us call a vector $g=({g}_{1},\dots ,{g}_{k})$ of Boolean functions on $[k]$ a Boolean kblock if the corresponding Boolean system $({\{0,1\}}^{k},g)$ is strictly quadratic and biquadratic and $[k]$ is minimal closed in this system. Let us define $R(k)$ for $k\ge 2$ as the maximal size of the range of any Boolean kblock. Let $\varrho (k)={(R(k))}^{1/k}$, and let $\varrho =max\{\varrho (k):2\le k\}$.
Returning to $(\mathrm{\Pi},f)$, we can see that ${\sum}_{\ell =1}^{L}{I}_{\ell}=n$ and for any C in the range of g, in particular, for any C that is a periodic orbit of the system, we must have
□
Now the theorem is a consequence of the following lemma.
Lemma 4 $\varrho (k)\le {10}^{1/4}$ for all integers $k\ge 2$.
Proof For $k=2$ we have $\varrho (2)=\sqrt{3}<{10}^{1/4}$, so let us assume $k>2$. Consider a Boolean kblock $g=({g}_{1},\dots ,{g}_{k})$. It is not hard to see that after a suitable renumbering of the input variables, we can assume wlog that ${g}_{i}$ takes inputs ${s}_{i}$, ${s}_{i+1}$ for all $i\in [k1]$ and ${g}_{k}$ takes inputs ${s}_{1}$, ${s}_{k}$. For ease of notation, let us identify $k+1$ with 1. We call $j\in [k]$ an onode if ${g}_{j}={s}_{j}\vee {s}_{j+1}$ and an anode if ${g}_{j}={s}_{j}\wedge {s}_{j+1}$. The proof of the lemma now splits into two cases.
Case 1: The sets of onodes and anodes are both nonempty
In this case we can group the variables in $[k]$ into one or more consecutive intervals ${I}_{m}=\{j:{i}_{m}<j\le {i}_{m+1}\}$ of length ${I}_{m}\ge 2$ in such a way that for each m, either ${i}_{m+1}$ will be an onode while all nodes j with ${i}_{m}<j\le {i}_{m+1}$ are anodes or ${i}_{m+1}$ will be an anode while all nodes j with ${i}_{m}<j\le {i}_{m+2}$ are onodes. Wlog assume the latter; the proof in the other case is symmetric. Then the restriction of a vector in the range of g to the variables in ${I}_{m}$ cannot have an isolated 1 in any of the positions ${i}_{m}+2,\dots ,{i}_{m+1}$, that is, if $g{(s)}_{j}=1$ for some j with ${i}_{m}<j\le {i}_{m+1}$, then we must also have $g{(s)}_{{j}^{\prime}}=1$ for some ${j}^{\prime}\in {I}_{m}$ with $j{j}^{\prime}=1$.
Let $\psi (n)$ be the number of Boolean vectors of length n that do not contain isolated 1s, except possibly in their first position. The related function $\phi (n)$ that counts the number of Boolean vectors of length n that do not contain any isolated 1s whatsoever was studied in [21]. Any vector that has exactly one isolated 1, in its first position, must start with the sequence 10, and it follows that for $n\ge 2$,
It was reported in [21] that $\phi (n)=c{\gamma}^{n}+{z}_{1}{z}_{2}^{n}+{\overline{z}}_{1}{\overline{z}}_{2}^{n}$, where $\gamma \approx 1.7549$ is the real root of ${x}^{3}2{x}^{2}+x1=0$, $c\approx 0.7221$, and ${z}_{1}$, ${z}_{2}$ are complex numbers with ${z}_{1}<0.25$ and ${z}_{2}<1$. Thus
which together with (8) gives a crude upper bound
for $n\ge 3$.
Since $\psi (2)=3<{10}^{3/4}$ and $\gamma <{10}^{1/4}\approx 1.7783$, it follows that $\psi (n)\le {10}^{n/4}$ for all $n\ge 2$. Now we conclude that the range R of g satisfies
as required.
Case 2: The set of onodes is empty or the set of anodes is empty
Wlog assume that all nodes are onodes; the proof in the other case is symmetric. In this case, any vector in the range of g cannot have isolated 1s, except in the case where it takes the value 1 both on its first and last positions (so that these 1s are not isolated with respect to a circular topology on the indices). Let $\tau (n)$ denote the number of such vectors of length n. A vector in our target set could have no isolated 1s whatsoever, could be obtained by adding a 1 at the beginning of a sequence that has at most one isolated 1, in its starting position, and then appending the sequence 01 at the end, or reversing such a vector. This doublecounts the vectors in the target set that start with 10 and end with 01. Thus in view of (8) we obtain
By (9) this gives a crude upper bound
for $n\ge 6$. Since $\gamma <{10}^{1/4}\approx 1.7783$ and $18.0876{\gamma}^{2}<{10}^{7/4}$, it follows that
holds for all $k\ge 7$. For the remaining $2\le n\le 6$, one can verify (10) by a direct calculation using the values reported in [22]. We find that $\tau (2)=3={1.7321}^{2}$, $\tau (3)=5={1.7100}^{3}$, $\tau (4)=10={1.7783}^{4}$, $\tau (5)=17={1.7623}^{5}$, $\tau (6)=29={1.7528}^{6}$. Thus equality holds in (10) for $n=4$; for all other $n\ge 2$, the inequality is strict, and the lemma follows. □
5 pUnstable strictly quadratic systems
In this section we derive even more stringent bounds on the maximal length of periodic orbits in quadratic systems that are αbiased (with sufficiently large α) than in the previous section, under the assumption that the system shows sufficiently large sensitivity to initial conditions. Let us first put this result into the context of previously constructed counterexamples.
For every positive integer n, there exists a 1unstable, strictly quadratic, biquadratic cooperative Boolean system of dimension 2n (Proposition 21 of [17]). Moreover, for all positive constants $p<1<c<2$ and all sufficiently large n, there exist ndimensional cooperative Boolean networks that are simultaneously biquadratic, cchaotic, punstable (Theorem 4 of [17]) and even pcchaotic (Theorem 3.2 of [6]). As long as $c<\sqrt{3}$, the analogue of the latter result holds for strictly quadratic, biquadratic cooperative Boolean networks (Theorem 3.10 of [6]). By choosing $\alpha =1$ and considering the limit as $p\to {1}^{}$ in the following theorem, we see that the upper bound on c in the latter counterexamples is optimal.
Theorem 4 Let $0\le \alpha \le 1$, let c be a constant such that $2\sqrt{0.75}<c<2$, and let $p>1.25\frac{\alpha}{2}+\frac{ln(0.5c)}{2ln0.75}$. Then no αbiased quadratic Boolean system can simultaneously be cchaotic and p1unstable.
Proof Let c be as in the assumption and assume $(\mathrm{\Pi},g)$ is a cchaotic strictly quadratic cooperative Boolean system of dimension n. A pair $(j,{j}^{\prime})$ with $j,{j}^{\prime}\in [n]$ will be called dominating if there are $i,{i}^{\prime}\in [n]$ such that $\{{s}_{i},{s}_{{i}^{\prime}}\}$ is the set of input variables for both ${g}_{j}$ and ${g}_{{j}^{\prime}}$, and at least one of the functions ${g}_{j}$, ${g}_{{j}^{\prime}}$ is biased. Let I be the set of all ${s}_{i}$ with outdegree 2 that act as an input of a dominating pair. □
Lemma 5 The set I has cardinality at most $\frac{2nln(0.5c)}{ln0.75}$.
Proof Let J be the union of all dominating pairs for which at least one input variable is in I. Note that if $(j,{j}^{\prime})$, $(k,{k}^{\prime})$ are dominating pairs of variables whose input variables contain variables with outdegree 2, then $\{j,{j}^{\prime}\}\cap \{k,{k}^{\prime}\}=\mathrm{\varnothing}$. Thus $J\ge I$.
Let $(j,{j}^{\prime})\in J$, and let i, ${i}^{\prime}$ be the corresponding indices of the inputs. Assume wlog that ${g}_{j}$ is biased and takes the value 1 on input vectors $x,y,z\in {\{0,1\}}^{\{i,{i}^{\prime}\}}$. Then ${g}_{{j}^{\prime}}$ takes the same value on at least two of the vectors x, y, z, and it follows that the range of ${g}_{j}\times {g}_{{j}^{\prime}}$ has size at most 3. Since we assumed that there exists a periodic orbit of length at least ${c}^{n}$, we must have ${3}^{J/2}{2}^{nJ}\ge {c}^{n}$, and the lemma follows by taking logarithms. □
Now let ${I}_{0}$ denote the set of variables ${s}_{i}$ with outdegree zero, ${I}_{1}$ denote the set of variables ${s}_{i}$ with outdegree 1 that act as an input to a biased regulatory function, and ${I}_{2}$ the set of variables ${s}_{i}$ outside of I with outdegree 2 that act as an input to two biased regulatory functions.
Consider a random initial state $s(0)$ and the state ${s}^{\ast}(0)$ obtained by flipping the value of the variable ${s}_{i}(0)$.
Clearly, if ${s}_{i}\in {I}_{0}$, then $s(1)={s}^{\ast}(1)$, since the variable ${s}_{i}$ is not used at all to calculate the next state.
If ${s}_{i}\in {I}_{1}$, then there is exactly one ${s}_{j}$ for which ${s}_{i}$ acts as an input. Since ${g}_{j}$ is assumed biased, it must take another input ${i}^{\prime}$, and there exists a value ${k}^{\prime}\in \{0,1\}$ such that the value of ${g}_{{j}^{\prime}}$ does not depend on the input ${s}_{i}$ as long as ${s}_{{i}^{\prime}}={k}^{\prime}$. The latter happens with probability 0.5; thus with probability ≥0.5, we will have $s(1)={s}^{\ast}(1)$.
Now consider the case when ${s}_{i}\in {I}_{2}$. Then there are ${j}^{\prime}\ne {j}^{\u2033}$ such that ${s}_{i}$ acts as an input to both ${g}_{{j}^{\prime}}$ and ${g}_{{j}^{\u2033}}$, and ${g}_{{j}^{\prime}}$, ${g}_{{j}^{\u2033}}$ are both biased. Since $i\notin I$ by definition of ${I}_{2}$, the other input variables ${s}_{{i}^{\prime}}$, ${s}_{{i}^{\u2033}}$ of ${g}_{{j}^{\prime}}$, ${g}_{{j}^{\u2033}}$ are distinct and different from ${s}_{i}$. Since ${g}_{{j}^{\prime}}$, ${g}_{{j}^{\u2033}}$ are both biased, there exist ${k}^{\prime},{k}^{\u2033}\in \{0,1\}$ such that neither the value of ${g}_{{j}^{\prime}}$ nor the value of ${g}_{{j}^{\u2033}}$ depends on the input ${s}_{i}$ as long as ${s}_{{i}^{\prime}}={k}^{\prime}$ and ${s}_{{i}^{\u2033}}={k}^{\u2033}$. The latter happens with probability 0.25; thus with probability ≥0.25, we will have $s(1)={s}^{\ast}(1)$.
Let us first assume for simplicity that $(\mathrm{\Pi},g)$ is strictly quadratic and biquadratic. Since the sum of all indegrees is equal to the sum of all outdegrees, the sets ${I}_{0}$ and ${I}_{1}$ are empty in this case. The set of variables that act as an input to at least one unbiased regulatory function has size less than $2(1\alpha )n$, thus we must have ${I}_{2}>2\alpha nnI$. Then, by Lemma 5,
Since with probability 0.25 a singlebit flip of a node in ${I}_{2}$ has no effect after one time step, inequality (11) implies that
and the theorem follows for this special case.
Now let us turn to the general case when $(\mathrm{\Pi},g)$ is only assumed quadratic. For each k, let ${I}_{k}^{\ast}$ denote the set of variables with outdegree k. Then ${I}_{0}^{\ast}={I}_{0}$, but ${I}_{1}$ as defined above may be a proper subset of ${I}_{1}^{\ast}$; similarly for ${I}_{2}$. Since the sum of all outdegrees must equal the sum of all indegrees and the system was assumed to be quadratic, we must have
We can deduce from (12) that
which in turn implies
As we mentioned above, ${I}_{0}={I}_{0}^{\ast}$. Moreover, since fewer than $(1\alpha )$ of all regulatory functions are unbiased, we have
Now it follows from (13) and (14) that
From the above and (15) we conclude that
and the theorem follows.
6 Generic behavior of cooperative networks
While our work so far has investigated the most extreme possible behavior (in terms of long periodic orbits), in this section we focus on the average behavior of cooperative Boolean networks. We first report some observations from simulation studies of cooperative Boolean networks that were randomly chosen from the class of all such networks with a specified maximum number r of inputs per node. Subsequently, we will formulate a conjecture on the expected behavior when the restriction on the number of inputs is removed and adduce some evidence for it.
In order to select a random Boolean network, it is important to understand how to select random cooperative regulatory functions $g:{\{0,1\}}^{r}\to \{0,1\}$ with at most r inputs. Such functions are in bijective correspondence with antichains aka Sperner families of $P={\{0,1\}}^{r}$, that is, subsets of P such that no two elements are comparable under the partial order ≤. For a given antichain A, one can define the function
and one can verify that the assignment $A\to {g}_{A}$ is a bijection. The number of antichains in the set ${\{0,1\}}^{r}$ is known as the Dedekind number $D(r)$ [23], and the exact values are only known for $r\le 8$. For $2\le r\le 5$, the Dedekind numbers are 6, 20, 168 and 7,581 respectively. For each of these choices of r, we computed a list of all antichains in the set ${\{0,1\}}^{r}$ and used the list to sample antichains uniformly. This sampling procedure is no longer feasible for $r=6$, as the corresponding Dedekind number is already $7,828,354$. We refrained from using ad hoc sampling methods for $r\ge 6$ as they do not guarantee a uniform distribution, and the inherent biases might invalidate the results.
Given n, one antichain ${A}_{k}$ in ${\{0,1\}}^{r}$ was selected at random and independently for each variable. Moreover, the sets ${D}_{k}$ of inputs to each regulatory function were chosen randomly and independently in order to create a random Boolean network. The regulatory functions ${g}_{k}$ were defined as in (16), with $A={A}_{k}$ and x representing the restriction of the input vector to the domain ${D}_{k}$ of ${g}_{k}$ after a suitable permutation of the variables. A random initial condition was selected, and the trajectory was calculated for all $t\le 30$. This procedure was repeated for $n=100$ and $n=1,000$, as well as $r=2,3,4,5$, with 20 repetitions for each setting. The results of this simulation are displayed in Figure 1, using the norm $s(t)={\sum}_{i}{s}_{i}(t)$ at each time step.
Notice that for $r=2$ the norms of the trajectories tend to remain near $\frac{n}{2}$. As r increases, the norms tend to converge towards 0 or n, indicating convergence of the trajectory towards $(0,\dots ,0)$ or $(1,\dots ,1)$ or to a small periodic orbit. The speed of convergence towards these steady states is similar for $n=100$ and $n=1,000$, but when r is increased from 4 to 5, we observe slightly faster convergence of the norm.
In order to estimate the distribution of the number of periodic orbits, their length, and the size of their basins of attraction, for each of $r=2,3,4,5$ we sampled 100 networks. For each network we uniformly sampled 100 initial conditions, ran the system until it converged towards a periodic orbit, and measured the length of the orbit. We kept track of the number of trajectories that converged towards a given periodic orbit. We classified periodic orbits into four types as follows: the first type comprises the constant vectors $(0,\dots ,0)$ and $(1,\dots ,1)$, which are always steady states in the system, i.e., periodic orbits of length 1; the second type comprises all other steady states; the third type comprises orbits of length 2 and 3; and the fourth type comprises all orbits of length larger than 3.
In Figure 2(a)(b) we display an estimated histogram for the total number of observed periodic orbits that were reached in each of the sampled networks, for $r=2,3,4$ (a) and $r=5$ (b). Notice that this information is necessarily incomplete, since many periodic orbits may not have been found. Nevertheless, one can clearly see that for $r=5$ the average number of periodic orbits is significantly reduced. Figure 2(c) classifies networks by their indegree r and the type of a periodic orbit, and it displays the average number of periodic orbits across all sampled networks. Figure 2(d) complements this information by describing the average size of the basin of attraction of a given periodic orbit, measured as a percentage of the state space. We also measured the size distribution of the basins of attraction. We partitioned the interval $[0,100]$ into five equal intervals ${I}_{1},\dots ,{I}_{5}$, and for each such interval, we counted how many periodic orbits of a given type have a basin of attraction with estimated size within that interval. The results for each value of r are displayed in Figure 2(e) through (h).
Notice that even though there might be several long periodic orbits in a given network, the basins of attraction of such periodic orbits tend to be very small. Periodic orbits of length >1 are reached from a significant fraction of initial conditions for $r\in \{2,3,4\}$, but for $r=4$ this fraction is already much smaller, and for $r=5$ it becomes negligible. Overall, we found that most trajectories for all r that we investigated converge towards a steady state. For $r\in \{2,3\}$, almost all of these are different from the constant vectors $(0,\dots ,0)$ and $(1,\dots ,1)$, and for $r=5$ most trajectories converge towards these two vectors. The largest basins of attraction on average comprise about half of the state space; for instance, if $r=5$ the average steady state of type 1 attracts 47% of the trajectories. Since there are two such steady states, they combine to attract an average of 96% of all trajectories.
Close inspection of a subset of our simulations confirmed that the most complex behavior occurs for $r=3$, with many trajectories reaching periodic orbits of the fourth type, that is, of length >3, that appear to have very small basins of attraction. On the other hand, some networks for $r=3$ appear to have a single steady state that attracts almost all initial conditions.
The above simulations indicate that for sufficiently large r, random cooperative networks tend to have highly ordered dynamics, and that the amount of chaos, at least in terms of the lengths of observed periodic orbits and the percentage of eventually frozen nodes, is very low. The latter is exactly the opposite of what is known for RBNs without the assumption of cooperativity, and it calls for a theoretical explanation.
For fixed r, consider the family $\mathcal{A}(r)$ of all antichains in ${\{0,1\}}^{r}$ with the uniform distribution. Furthermore, for $x\in {\{0,1\}}^{r}$, let $p(r,x)$ denote the probability that $x\le a$ for some $a\in A$, when A is randomly chosen from $\mathcal{A}(r)$. By symmetry, $p(r,x)$ depends only on r and $x$, so we can extend it to a function defined on pairs of positive integers, with $p(r,k)=p(r,x)$ for $x=k$. See Figure 3 for calculations of the value of $p(r,k)$ for different values of r, k, displayed both in table form in panel (a) and in normalized form in panel (b).
While there exists a vast literature on antichains (see [24] for an encyclopedic review), the function $p(r,k)$ appears not to have been explicitly investigated. The literature indicates that the vast majority of antichains tend to mostly contain elements of size very close to $\frac{r}{2}$; in particular, the proofs of asymptotic formulas for the number of antichains on ${\{0,1\}}^{r}$ that were derived in [25] and [26] point in this direction. Thus it appears that if $k(r)$ grows a little slower than $\frac{r}{2}$, we should have ${lim}_{r\to \mathrm{\infty}}p(r,k(r))=1$, and if $k(r)$ grows a little faster than $\frac{r}{2}$, we should have ${lim}_{r\to \mathrm{\infty}}p(r,k(r))=0$.
Let us call a function $\kappa :{\mathbb{Z}}^{+}\to {\mathbb{Z}}^{+}$ fast if $p(r,\frac{r}{2}+\kappa (r))=o({r}^{1})$ and $p(r,\frac{r}{2}\kappa (r))=1o({r}^{1})$.
Conjecture 1 There exists a fast function κ such that $\kappa (r)=o(\sqrt{r})$.
This conjecture appears to be highly plausible [27], but may not immediately follow from known results. To see why it seems plausible, consider the related function ${p}^{\ast}(r,k)$ that is defined like $p(r,k)$, but for antichains A that are randomly drawn from the family of all antichains on ${\{0,1\}}^{r}$ that consist of elements with identical norms. Then for $k>\frac{r}{2}$ the probability ${p}^{\ast}(r,k)$ is bounded from above by the probability that a randomly chosen antichain in the restricted class consists of elements with norm ℓ for some $\ell \ge k$. Note that for $k>\frac{r}{2}$ we have $\left(\genfrac{}{}{0ex}{}{k}{\ell}\right)\le \left(\genfrac{}{}{0ex}{}{r}{\lfloor r/2\rfloor}\right)\frac{rk}{k+1}$. This in turn implies that if $k>\frac{r+c\sqrt{r}}{2}$ for some $c>0$, then
and the analogue of Conjecture 1 for ${p}^{\ast}(r,k)$ with $k>r$ follows since $\left(\genfrac{}{}{0ex}{}{r}{\lfloor r/2\rfloor}\right)$ grows much faster than . For $k<r$ we get the same orderofmagnitude estimates, and the analogous result follows from the additional observation that if A is a randomly chosen antichain that consists of elements with norm $\ell >k$, then for a given x with $x=k$, the probability that A contains an a with $x\le a$ is equal to $1{2}^{\left(\genfrac{}{}{0ex}{}{\ell}{k}\right)}$.
It may be possible to extract a proof of the conjecture by carefully analyzing the arguments in [25, 26], but this is not easy and would go beyond the scope of this paper.
Our next result shows that Conjecture 1 has a striking consequence for the dynamics of random cooperative networks without restrictions on the number of inputs r per variable. The explicit calculations and simulations that we were able to perform for small values of r (see Figures 3 and 2) add some credibility to this consequence of the conjecture.
Lemma 6 Assume that Conjecture 1 holds. Then the probability that the trajectory of a randomly chosen initial condition in a randomly chosen ndimensional cooperative Boolean network reaches either the steady state vector $(0,\dots ,0)$ or the steady state vector $(1,\dots ,1)$ after one updating step approaches 1 as $n\to \mathrm{\infty}$.
Proof For fixed n, choosing a random cooperative network can be conceptualized as the same procedure as we have been following in our simulations, but with $r=n$. Thus for each $k\in [n]$ we randomly and independently choose an antichain ${A}_{k}\in \mathcal{A}(n)$, and then we define the regulatory function ${g}_{k}={g}_{{A}_{k}}$, as in (16).
Now fix a probability $0<q<1$, and let κ be as in Conjecture 1. Consider a randomly chosen initial condition $s(0)$. Then, for sufficiently large n, the probability that $s(0)\frac{n}{2}<\kappa (n)$ will be smaller than $\frac{1q}{2}$. Moreover, if $\frac{n}{2}s(0)\ge \kappa (n)$, then the probability that $s(1)\ne (0,\dots ,0)$, i.e., that at least one of the functions takes the value ${g}_{{A}_{k}}(s(0))=1$, can be assumed to be $<\frac{1q}{2}$; similarly, if $s(0)\frac{n}{2}\ge \kappa (n)$, then the probability that $s(1)\ne (1,\dots ,1)$, i.e., that at least one of the functions takes the value ${g}_{{A}_{k}}(s(0))=0$, can be assumed to be $<\frac{1q}{2}$.
This implies that with probability ≥q, one of these two steady states will be reached after one updating step. □
Now consider what happens if we draw random cooperative networks and initial conditions as described at the beginning of this section for r moderately large but fixed. If $s(0)=n+\alpha \sqrt{n}$, then the expected value of $x$ for the input vectors of the functions ${g}_{{A}_{k}}$ is $r(1+\frac{\alpha}{n})$. Thus if $\alpha >0$, we should see on average more input vectors with norm significantly larger than $\frac{r}{2}$ than input vectors with norm significantly smaller than $\frac{r}{2}$ and vice versa. Thus if $p(r,k)$ decays sufficiently fast to 0 as $k\frac{r}{2}$ increases, $s(1)\frac{r}{2}$ should be expected to have a larger absolute value and the same sign as $s(0)\frac{r}{2}$, and the effect should amplify during subsequent iterations, until a steady state or a periodic orbit with all norms close to 0 or n is reached. This seems to be exactly what we observe in our simulations for $r\in \{4,5\}$.
7 Conclusions
Very long periodic orbits are a hallmark of chaotic dynamics in Boolean networks. It has long been known that such features as few inputs per node and prevalence of significantly biased regulatory functions reduce, on average, the propensity towards chaotic behavior in such networks, in particular, the prevalence of very long periodic orbits. However, nontrivial upper bounds on the lengths of periodic orbits had previously been proved only for some very restricted classes of Boolean networks.
The main result of this paper, Theorem 2, shows the existence of such bounds if both the number of inputs and the number of outputs per node are bounded by a constant and a fixed minimal fraction of all regulatory functions is assumed to be biased. Since there are only finitely many different Boolean functions on a given set of inputs, the assumptions of this theorem imply a lower bound on the amount of bias we see in each regulatory function. However, the analogue of the theorem fails if it is only assumed that a fixed fraction of regulatory functions shows a specified minimal amount of bias, even when the number of inputs (but not outputs) of each regulatory function is bounded. This follows from a previously published result that is reproduced as Theorem 1(ii) here.
If both the number of inputs and that of outputs are bounded by 2 and all regulatory functions are biased, then ${10}^{n/4}$ is an upper bound on the length of periodic orbits in ndimensional networks. This result is proved in full generality in the preprint [17]; here we illustrated the main ideas of the proof by deriving the special case for cooperative networks (Theorem 3). By previously published results, the upper bound is optimal. It can be further improved for systems that show p1instability for sufficiently large $p<1$ (Theorem 4). For $p\to {1}^{}$ this gives an upper bound of ${3}^{n/2}$ on the length of periodic orbits in ndimensional strictly quadratic cooperative Boolean networks. Again the latter bound is optimal by a result of [6], even for systems that have the stronger property of being punstable. Both pinstability and p1instability are formal counterparts of the general notion of sensitivity to initial conditions, which is considered to be another hallmark of chaotic dynamics. While sensitive dependence for Boolean systems can be formalized in a variety of ways (see [6]), p1instability for at least some $p>0$ is implied by all meaningful formal definitions.
Cooperativity is the absence of negative interactions, in particular, negative feedback loops. Previous empirical studies had already shown that reducing the amount of negative feedback tends to reduce, on average, the propensity towards chaotic dynamics in Boolean networks [28]. Simulation studies reported in Section 6 above indicate that cooperative Boolean networks that are randomly drawn from the class of all such networks with at most r inputs per node tend to have trajectories that quickly converge to a steady state or a small periodic orbit. The effect becomes more pronounced as r increases. For $r\in \{4,5\}$, almost all sampled trajectories converged to steady states, and for $r=5$, most of these were constant Boolean vectors. Thus the dynamics of random cooperative Boolean networks appears to become less chaotic, at least in terms of long periodic orbits and the proportion of eventually frozen nodes, as the number of inputs per node increases; exactly the opposite of what has been observed for RBNs without an assumption of cooperativity. We stated a conjecture about the distribution of sizes of sets in randomly chosen antichains that appears to conform with, but not immediately follow from, known results about these combinatorial objects. The conjecture implies that if a cooperative Boolean network and an initial condition are randomly chosen (without any restrictions on the number of inputs per node), the probability that a steady state is reached after only one step approaches 1 as the dimension of the network increases without bound.
These results open up several new avenues of further research. Since Theorem 2 assumes a fixed bound on the number of outputs, it does not directly apply to the study of RBNs from the class for which an upper bound r on the number of inputs is the only restriction. With probability approaching 1 as $n\to \mathrm{\infty}$, the fraction of biased regulatory functions will be very close to the fraction of biased Boolean functions among all those with r inputs, so the vast majority of such networks will be αbiased for suitable α. However, the number of outputs per node will roughly follow a Poisson distribution with parameter $\lambda =r$, with only very few nodes having a (moderately) large number of outputs. The known counterexamples do not preclude a generalization of Theorem 2 to this weaker assumption on the distribution of outputs, and it becomes a natural question whether one can prove or disprove such a version of the theorem. Similarly, it might be of interest to find generalizations of Theorems 3 and 4 that deal with the case $r=2$ to corresponding networks with $r>2$.
In Section 6 we defined a function $p(r,k)$ that expresses the size distributions of sets in antichains aka Sperner families. As we argued at the end of that section, a characterization of the asymptotic behavior of the function $p(r,k)$ should allow one to derive analytic bounds on the probability of trajectories in random cooperative Boolean networks with up to r inputs per node eventually reaching a steady state, and upper bounds on the expected lengths of the transients. In our opinion, the function $p(r,k)$ deserves more systematic study by combinatorists. A characterization of the asymptotic behavior of this function would allow precise quantification of the wellknown observation that for large r the overwhelming majority of Sperner families on ${\{0,1\}}^{r}$ contains predominantly vectors with close to $r/2$ coordinates equal to 0. Of particular interest from our point of view would be a proof of Conjecture 1, which hypothesizes specific bounds on asymptotic behavior of this function.
References
 1.
Chuang HY, Hofree M, Idekker T: A decade of systems biology. Annu. Rev. Cell Dev. Biol. 2010, 26: 721744. 10.1146/annurevcellbio100109104122
 2.
Tindall MJ, Porter SL, Maini PK, Gaglia G, Armitage JP: Overview of mathematical approaches used to model bacterial chemotaxis I: the single cell. Bull. Math. Biol. 2008, 70: 15251569. 10.1007/s1153800893216
 3.
Albert R, Othmer HG: The topology of the regulatory interactions predicts the expression pattern of the segment polarity genes in Drosophila melanogaster. J. Theor. Biol. 2003, 223: 118. 10.1016/S00225193(03)000353
 4.
Sontag ED: Monotone and nearmonotone biochemical networks. Syst. Synth. Biol. 2007, 1: 5987. 10.1007/s1169300790059
 5.
Smith HL Math Surveys and Monographs. In Monotone Dynamical Systems. Am. Math. Soc., Providence; 1995.
 6.
Just W, Malicki M: Cooperative Boolean systems with generically long attractors II. Adv. Differ. Equ. 2013., 2013: Article ID 268
 7.
Aldana M, Coppersmith S, Kadanoff LP: Boolean dynamics with random couplings. In Perspectives and Problems in Nonlinear Science. Edited by: Kaplan E, Marsden JE, Sreenivasan KR. Springer, Berlin; 2003:2390.
 8.
Drossel B: Random Boolean networks. 1. In Reviews of Nonlinear Dynamics and Complexity. Edited by: Schuster HG. Wiley, New York; 2008:69110.
 9.
Kauffman SA: Origins of Order: SelfOrganization and Selection in Evolution. Oxford University Press, Oxford; 1993.
 10.
Kaufman V, Drossel B: On the properties of cycles of simple Boolean networks. Eur. Phys. J. B 2005, 43: 115124. 10.1140/epjb/e2005000346
 11.
Paul U, Kaufman V, Drossel B: Properties of attractors of canalyzing random Boolean networks. Phys. Rev. Lett. 2006., 73: Article ID 026118
 12.
Ho JL: Global convergence for the XOR Boolean networks. Taiwan. J. Math. 2009, 13(4):12711282.
 13.
Ho JL: A global convergence theorem in Boolean algebra. Taiwan. J. Math. 2010, 14(3B):11351144.
 14.
Jarrah AS, Laubenbacher R, VelizCuba A: The dynamics of conjunctive and disjunctive Boolean network models. Bull. Math. Biol. 2010, 72: 14251447. 10.1007/s115380109501z
 15.
Arcena J, Demongeot J, Goles E: On limit cycles of monotone functions with symmetric connection graph. Theor. Comput. Sci. 2004, 322: 237244. 10.1016/j.tcs.2004.03.010
 16.
Enciso GA, Just W: Analogues of the Smale and Hirsch theorems for cooperative Boolean and other discrete systems. J. Differ. Equ. Appl. 2012, 18: 223238. 10.1080/10236190903357535
 17.
Just, W, Enciso, GA: Extremely Chaotic Boolean Networks. Preprint (2008). arXiv:0811.0115.
 18.
Just W, Enciso G: Exponentially long orbits in Boolean networks with exclusively positive interactions. Nonlinear Dyn. Syst. Theory 2011, 11: 275284.
 19.
Just W, Malicki M: Cooperative Boolean systems with generically long attractors I. J. Differ. Equ. Appl. 2013, 19: 772795. 10.1080/10236198.2012.691167
 20.
Hoeffding W: Probability inequalities for sums of bounded random variables. J. Am. Stat. Assoc. 1963, 58(301):1330. 10.1080/01621459.1963.10500830
 21.
Austin RB, Guy RK: Binary sequences without isolated ones. Fibonacci Q. 1978, 16: 8486.
 22.
McGarvey, G: Sequence A109377. The OnLine Encyclopedia of Integer Sequences, Sloane, NJA (ed.) (2008). Published electronically at http://oeis.org/A109377.
 23.
Schröder BS: Ordered Sets: An Introduction. Birkhäuser, Boston; 2003.
 24.
Engel K Encyclopedia of Mathematics and Its Applications 65. In Sperner Theory. Cambridge University Press, Cambridge; 1997.
 25.
Kleitman D, Markowsky G: On Dedekind’s problem: the number of isotone Boolean functions II. Trans. Am. Math. Soc. 1975, 213: 373390.
 26.
Korshunov AD: The number of monotone Boolean functions. Probl. Kibern. 1981, 38: 5108. (in Russian)
 27.
Engel, K: Private communication. October 29, 2012
 28.
Sontag ED, VelizCuba A, Laubenbacher R, Jarrah AS: The effect of negative feedback loops on the dynamics of Boolean networks. Biophys. J. 2008, 95(2):518526. 10.1529/biophysj.107.125021
Acknowledgements
We would like to thank the referees for insightful and valuable suggestions on how to improve the manuscript.
Author information
Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
The results of Sections 35 are mainly due to WJ; Section 6 is mainly due to GE. Both authors equally contributed to the editing of the entire material, read, and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Just, W., Enciso, G.A. Ordered dynamics in biased and cooperative Boolean networks. Adv Differ Equ 2013, 313 (2013). https://doi.org/10.1186/168718472013313
Received:
Accepted:
Published:
Keywords
 Boolean networks
 cooperative dynamical systems
 biased regulatory functions
 chaotic dynamics
 Sperner families