# Stochastic Model for In-Host HIV Dynamics with Therapeutic Intervention

Authors: Waema R. Mbogo; Livingstone S. Luboobi; John W. Odhiambo
Journal: ISRN Biomathematics
 (2013)

---

## Abstract

Untangling the dynamics between HIV and CD4 cellular populations
and molecular interactions can be used to investigate the effective points
of interventions in the HIV life cycle. With that in mind, we propose
and show the usefulness of a stochastic approach towards modeling HIV
and CD4 cells’ dynamicsin vivo by obtaining probability generating
function, the moment structures of the healthy CD4 cell and the virus
particles at any time t, and the probability of HIV clearance. The unique
feature is that both therapy and the intracellular delay are incorporated
into the model.
Our analysis shows that, when it is assumed that the drug is not
completely effective as is the case of HIV in vivo, the probability of
HIV clearance depends on two factors: the combination of drug efficacy
and length of the intracellular delay and also the education of the infected
patients. Comparing simulated data  before and after treatment indicates the importance of combined therapeutic intervention and intracellular delay in having low, undetectable viral load in HIV-infected
person.


---

## Body

## 1. Introduction

Since HIV pandemic first became visible, enormous mathematical models have been developed to describe the immunological response to infection with human immunodeficiency virus (HIV). Mathematical modeling has proven to be valuable in understanding the dynamics of infectious diseases with respect to host-pathogen interactions. When HIV enters the body, it targets all the cells with CD4 receptors including the CD4 T cells. The knowledge of principal mechanisms of viral pathogenesis, namely, the binding of the retrovirus to the gp120 protein on the CD4 cell, the entry of the viral RNA into the target cell, the reverse transaction of viral RNA to viral DNA, the integration of the viral DNA with that of the host, and the action of viral protease in cleaving viral proteins into mature products, has led to the design of drugs (chemotherapeutic agents) to control the production of HIV.Chronic HIV-infection causes gradual depletion of the CD4 T-cell poll and, thus, progressively compromises the host’s immune response to opportunistic infections, leading to acquired immunodeficiency syndrome (AIDS) [1]. With the spread of the HIV-AIDS pandemic and in the absence of an “effective” vaccine or cure, therapeutic interventions are still heavily relied on. Several research studies have been carried out in the recent past, both theoretically and experimentally, to analyse the impact of therapy on the viral load in HIV-infected persons in order to ascertain the effectiveness of the treatment (see, e.g., [2–8]). Their utility lies in the ability to predict an infected steady state and examining the effects that the changes in parameters have on the outcome of the system over time to determine which parameters are most important in disease progression, and further determine critical threshold values for these parameters.In HIV-infected individuals, the infection exhibits a long asymptomatic phase (after the initial high infectious phase) of approximately 10 years on average before the onset of AIDS. During this incubation period, which some call the clinical latency period, the individuals appear to be well and may contribute significantly to the spread of the epidemic in a community [9]. Some clinical markers such as the CD4 cell count and the RNA viral load (viraemia) provide information about the progression of the disease in infected individuals. Also, the clinical latency period of the disease may provide a sufficiently long period during which one can attempt an effective suppressive therapeutic intervention in HIV infections. Various biological reasons lead to the introduction of time delays in models of disease transmission. Time delays are used to model the mechanisms in the disease dynamics (see, e.g., [10, 11]).Intracellular delays and the target-cell dynamics such as mitosis are two key factors that play an important role in the viral dynamics. Mitosis in healthy or infected target-cell population are typically modelled by a logistic term [2, 12–16]. Intracellular delays have been incorporated into the incidence term in finite or distributed form [4, 17–23]. In [13, 16], in-host viral models with a logistic growth term without intracellular delays are investigated, and it is shown that sustained oscillations can occur through Hopf bifurcation when the intrinsic growth rate increases. It is shown in [17, 23], in in-host models with both a logistic growth term and intracellular delay, that Hopf bifurcations can occur when the intracellular delay increases. In [19], using in-host models with a general form of target-cell dynamics and general distributions for intracellular delays, it is shown that the occurrence of Hopf bifurcation in these models critically depends on the form of target-cell dynamics. More specifically, it is proved in [20] that, if the target-cell dynamics are such that no Hopf bifurcations occur when delays are absent, introducing intracellular delays in the model will not lead to Hopf bifurcations or periodic oscillations.To incorporate the intracellular delay phase of the virus life cycle, [24] assumed that virus production occurs after the virus entry by a constant delay τ. They came up with a basic in-host compartmental model of the viral dynamics containing three compartments: x(t), y(t), and v(t) denoting the populations of uninfected target cells, infected target cells that produce virus, and free virus particles, respectively. They further assumed that parameters δ, α, and μ are turnover rates of the x,y, and v compartments, respectively. Uninfected target cells are assumed to be produced at a constant rate λ. They assumed also that cells infected at time t will be activated and produce viral materials at time t+τ. In their model, constant s is the death rate of infected but not yet virus-producing cells, and e-sτ describes the probability of infected target cells surviving the period of intracellular delay from t-τ to t. Constant κ denotes the average number of virus particles that each infected cell produces. Preceding assumptions lead to the following system of differential equations:
(1)dxdt=λ-δx(t)-βx(t)v(t),dydt=βx(t-τ)v(t-τ)e-sτ-αy(t),dvdt=κy(t)-μv(t).System (1) can be used to model the infection dynamics of HIV, HBV, and other viruses [2, 12–14, 25, 26]. It can also be considered as a model for the HTLV-I infection if x(t),y(t), and v(t) are regarded as healthy, latently infected, and actively infected CD4 T cells [14, 15]. For detailed description and derivation of the model, as well as the incorporation of intracellular delays, we refer the reader to [24].From the literature, many researchers have employed deterministic models to study HIV internal dynamics, ignoring the stochastic effects. We consider a stochastic model for the interaction of HIV virus and the immune system in an HIV-infected individual undergoing a combination-therapeutic treatment. Our aim in this paper is to use a stochastic model obtained by extending the model of [24] to determine the probability distribution, variance and covariance structures of the uninfected CD4+ cells, infected CD4 cells, and the free HIV particles in an infected individual at any time t by examining the combined antiviral treatment of HIV. Based on the model, we obtain joint probability distribution, expectations, variance and covariance structures of variables representing the numbers of uninfected CD4 cells, the HIV-infected CD4 T cells, and the free HIV particles at any time t and derive conclusions for the reduction or elimination of HIV in HIV-infected individuals, which is one of the main contributions of this paper.The organization of this paper is as follows: in Section2, we formulate our stochastic model describing the interaction of HIV and the immune system and obtain a partial differential equation for the probability generating function of the numbers of uninfected CD4 cells, the HIV-infected CD4 T cells, and the free HIV particles at any time t, also moments for the variables are derived here. In Section 3, we derive the moments of the variables in a therapeutic environment and probability of extinction of HIV virus and also provide a numerical illustration to demonstrate the impact of intercellular delay and therapeutic intervention in controlling the progression of HIV. Some concluding remarks follow in Section 4.


## 2. HIV and CD4 Cells Dynamics before Therapeutic Intervention

To study the interaction of HIV virus and the immune system, we propose a stochastic model by extending the deterministic model presented in the literature. A stochastic process is defined by the probabilities with which different events happen in a small time intervalΔt. In our model, there are two possible events (production and death/removal) for each population (uninfected cells, infected cells, and the free virons). The corresponding rates in the deterministic model are replaced in the stochastic version by the probabilities that any of these events occur in a small time interval Δt.(
1)  The Interaction of HIV Virus and the CD4 T-Cells. A typical life-cycle of HIV virus and immune system interaction is shown in Figure 1.Figure 1
The interaction of HIV virus and the CD4+ T cells.LetX(t) be the size of the healthy cells population at time t, Y(t) be the size of infected cell population at time t, and V(t) be the size of the virons population at time t. In the model to be formulated, it is now assumed that instead of rates of births and deaths, there is a possibility of stochastic births or deaths of the heathy cells, infected cells and the virus particles. Thus, X(t), Y(t), and V(t) are time-dependent random variables. This epidemic process can be modeled stochastically by letting the nonnegative integer values process X(t), Y(t), and V(t), respectively, represent the number of healthy cells, infected cells, and virons of the disease at time t. Then, {(X(t),Y(t),V(t)):t≥0} can be modeled as continuous time multivariate Markov chain. Let the probability of there being x healthy cells, y infected cells, and v virons in an infected person at time t be denoted by the following joint probability function: Px,y,v(t)=P[X(t)=x,Y(t)=y,V(t)=v], for x,y,v=0,1,2,3….The standard argument using the forward Chapman-Kolmogorov differential equations is used to obtain the joint probability functionPx,y,v(t), by considering the joint probability Px,y,v(t,t+Δt). This joint probability is obtained as the sum of the probabilities of the following mutually exclusive events.(
2)  Population Change Scenarios.Consider the following points.(1)
There werex healthy cells, y infected cells, and v virons by time t, and nothing happens during the time interval (t,t+Δt).(2)
There werex-1 healthy cells, y infected cells, and v virons by time t, and one healthy cell is produced from the thymus during the time interval (t,t+Δt).(3)
There werex+1 healthy cells, y infected cells, and v virons by time t, and one healthy cell dies or is infected by HIV virus during the time interval (t,t+Δt).(4)
There werex healthy cells, y-1 infected cells, and v virons by time t, and one healthy cell is infected by HIV virus during the time interval (t,t+Δt).(5)
There werex healthy cells, y+1 infected cells, and v virons by time t and one infected cell dies (HIV-infected cell bursts or undergoes a lysis) during the time interval (t,τ).(6)
There werex healthy cells, y infected cells, and v-1 virons by time t and one viron is produced (HIV-infected cell undergoes a lysis or the individual angages in risky behaviour) during the time interval (t,t+Δt).(7)
There werex healthy cells, y infected cells, and v+1 virons by time t, and one viron dies during the time interval (t,t+Δt).We incorporate a time delay between infection of a cell and production of new virus particles, we letτ be the time lag between the time the virus contacts a target CD4 T cell and the time the cell becomes productively infected (including the steps of successful attachment of the virus to the cell and penetration of virus into the cell); this means the recruitment of virus producing cells at time t is given by the density of cells that were newly infected at time t-τ and are still alive at time t. If we also let ρ be the death rate of infected but not yet virus producing cell, then the probability that the infected cell will survive to virus producing cell during the short time interval τ will be given by e-ρτ.(
3)  Variables and Parameters for the Model. The variables and parameters in the model are described as in Table 1.Table 1
(a) Variables for the stochastic model. (b) Parameters for the stochastic model.
(a)
Variable
Description
Initial conditiont=0
X
(
t
)
The concentration of uninfected CD4 cells at timet
100
Y
(
t
)
The concentration of infected CD4 cells at timet
0.02
V
(
t
)
The concentration of virus particles at timet
0.001
(b)
Parameter symbol
Parameter description
Estimate
(
1
-
α
)
The reverse transcriptase inhibitor drug effect
0.5
(
1
-
ω
)
The protease inhibitor drug effect
0.5
λ
The total rate of production of healthy CD4 cells
10
δ
The per capita death rate of healthy CD4 cells
0.02
β
The transmission coefficient between uninfected CD4 cells and infective virus particles
0.000024
κ
Per capita death rate of infected CD4 cells
0.5
γ
The virus production rate due to risk behaviors
0.001
μ
The per capita death rate of infective virus particles
3
ρ
The death rate of infected but not yet virus producing cell
0.5
τ
Time lag during infection
0.5
N
The average number of infective virus particles produced by an infected CD4 cell in the absence of treatment during its entire infectious lifetime
1000Using the population change scenarios and parameters in Table1, we now summarize the events that occur during the interval (t,t+Δ) together with their transition probabilities in Table 2.Table 2
Transitions of in-host interaction of HIV.
Possible transitions in host interaction of HIV and immune system cells and corresponding probabilities
Event
Population(X,Y,V) at t
Population(X,Y,V) at (t,t+Δ)
Probabilityof transition
Production of uninfected cell
(
x
-
1
,
y
,
v
)
(
x
,
y
,
v
)
λ
Δ
t
Death of uninfected cell
(
x
+
1
,
y
,
v
)
(
x
,
y
,
v
)
δ
(
x
+
1
)
Δ
t
Infection of uninfected cell
(
x
+
1
,
y
-
1
,
v
+
1
)
(
x
,
y
,
v
)
β
(
x
+
1
)
(
v
+
1
)
e
-
ρ
τ
Δ
t
Production of virons from the bursting infected cell
(
x
,
y
+
1
,
v
-
1
)
(
x
,
y
,
v
)
κ
N
(
y
+
1
)
Δ
t
Introduction of virons due to reinfection because of risky behaviour
(
x
,
y
,
v
-
1
)
(
x
,
y
,
v
)
γ
Δ
t
Death of virons
(
x
,
y
,
v
+
1
)
(
x
,
y
,
v
)
μ
(
v
+
1
)
Δ
tThe change in population size during the time intervalΔt, which is assumed to be sufficiently small to guarantee that only one such event can occur in (t,t+Δt), is governed by the following conditional probabilities:
(2)Px,y,v(t+Δt)={1-(λΔt+δxΔt+βxvΔt+μvΔt+κyΔt+γΔt)+o(Δt)}Px,y,v(t)+{λΔt+o(Δt)}Px-1,y,v(t)+{δ(x+1)Δt+o(Δt)}Px+1,y,v(t)+{β(x+1)(v+1)e-ρτΔt+o(Δt)}×Px+1,y-1,v+1(t)+{κN(y+1)Δt+o(Δt)}Px,y+1,v-1(t)+{γΔt+o(Δt)}Px,y,v-1(t)+{μ(v+1)Δt+o(Δt)}Px,y,v+1(t).
Simplifying (2), we have the following forward Kolmogorov partial differential equations for Px,y,v(t):
(3)Px,y,v′(t)=-{λ+δx+βe-ρτxv+μv+κNy+γ}Px,y,v(t)+λPx-1,y,v(t)+δ(x+1)Px+1,y,v(t)+β(x+1)(v+1)e-ρτPx+1,y-1,v+1(t)+Nκ(y+1)Px,y+1,v-1(t)+γPx,y,v-1(t)+μ(v+1)Px,y,v+1(t).
This will also be referred to as the Master equation or the Differential-Difference equation, with the condition
(4)P0,0,0′(t)=-(λ+γ)P0,0,0(t)+δP1,0,0(t)+μP0,0,1(t).


### 2.1. The Probability Generating Function

The probability generating function of(X(t),Y(t),V(t)) is defined by
(5)G(z1,z2,z3,t)=∑x=0∞∑y=0∞∑v=0∞Px,y,v(t)z1xz2yz3v.
Differentiating (5) with respect to t yields
(6)∂G(z1,z2,z3,t)∂t=∑x=0∞∑y=0∞∑v=0∞Px,y,v′(t)z1xz2yz3v.
Differentiating again (5) with respect to z1,z2, and z3 yields
(7)∂3G(z1,z2,z3,t)∂z1∂z2∂z3=∑x=1∞∑y=1∞∑v=1∞xyvPx,y,v(t)z1x-1z2y-1z3v-1=∑x=0∞∑y=0∞∑v=0∞(x+1)(y+1)(v+1)Px+1,y+1,v+1(t)z1xz2yz3v.
Multiplying (3) by z1xz2yz3v and summing over x, y, and v, then applying (4), (5), (6), and (7) and on simplification we obtain
(8)∂G∂t={(z1-1)λ+(z3-1)γ}G+(1-z1)δ∂G∂z1+(z3-z2)κN∂G∂z2+(1-z3)μ∂G∂z3+βe-ρτ(z2-z1z3)∂2G∂z1∂z3.
This is called Lagrange partial differential equation for the probability generating function (pgf).Attempt to solve (8) gave us the following solution:
(9)G(z1,z2,z3,t)=aebt{∂2F(z1,z2,z3)∂z1∂z3{(z1-1)λ+(z3-1)γ}F(z1,z2,z3)aebt+(1-z1)δ∂F(z1,z2,z3)∂z1aebt+(Nz3-z2)κ∂F(z1,z2,z3)∂z2aebt+(1-z3)μ∂F(z1,z2,z3)∂z3aebt+β(e-ρτz2-z1z3)∂2F(z1,z2,z3)∂z1∂z3},
where a and b are constants.Equation (9) is not solvable, even for any simple form of F(z1,z2,z3). However, it is possible to obtain the moment structure of (X(t);Y(t);V(t)) from (8).


### 2.2. The Marginal Generating Functions

Recall that(10)G(z1,1,1,t)=∑x=0∞∑y=0∞∑v=0∞‍Px,y,v(t)z1x.
Assuming that z2=z3=1, z1=z3=1, and z2=z1=1 and solving (8), we obtain the marginal partial generating functions for X(t), Y(t), and V(t), respectively,
(11)∂G(z1;t)∂t=∂G(z1,1,1;t)∂t=(z1-1)λG+(1-z1)δ∂G∂z1+βe-ρτ(1-z1)∂2G∂z1∂z3,∂G(z2;t)∂t=∂G(1,z2,1;t)∂t=(1-z2)κN∂G∂z2+βe-ρτ(z2-1)∂2G∂z1∂z3,∂G(z3;t)∂t=∂G(1,1,z3;t)∂t=(z3-1)γG+(z3-1)κN∂G∂z2+(1-z3)μ∂G∂z3+βe-ρτ(1-z3)∂2G∂z1∂z3.


### 2.3. Numbers of CD4 T Cells and the Virons

As we know from probability generating function,(12)∂Gx∂z=∑x=0∞xPx(t)zx-1.
Letting z=1, we have
(13)∂Gx∂z|z=1=∑x=0∞xPx(t)zx-1=E[X].
Differentiating the partial differential equations of the pgf, we get the moments of X(t), Y(t), and V(t).Differentiating (11) with respect to z1, z2, and z3, respectively, and setting z1=z2=z3=1, we have
(14)∂∂tE[X(t)]=λ-δE[X(t)]-βE[X(t)V(t)],∂∂tE[Y(t)]=-κE[Y(t)]+βe-ρτE[X(t)V(t)],∂∂tE[V(t)]=γ+NκE[Y(t)]-μE[V(t)]-βE[X(t)V(t)].
Therefore, the moments of (X(t),Y(t),V(t)) from the pgf before treatment are as follows:
(15)∂∂tE[X(t)]=λ-δE[X(t)]-βE[X(t)V(t)],∂∂tE[Y(t)]=-κE[Y(t)]+βe-ρτE[X(t)V(t)],∂∂tE[V(t)]=γ+NκE[Y(t)]-μE[V(t)]-βE[X(t)V(t)].
The corresponding deterministic model of HIV-host interaction as formulated in [24] is given as follows:
(16)dxdt=λ-δx(t)-βx(t)v(t),dydt=βe-ρτx(t-τ)v(t-τ)-κy(t),dvdt=γ+Nκy(t)-μv(t)-βx(t)v(t).
Comparing system of (15) with the system of (16), we see that expected values of the multivariate Markov process [X(t),Y(t),V(t)] satisfies the corresponding deterministic model of the HIV-host interaction dynamics.


#### 2.3.1. Simulation

Using the parameter values and initial conditions defined in Table1, we illustrate the general dynamics of the CD4-T cells and HIV virus for model (15) during infection and in the absence of treatment.The second graph in Figure2 is the population dynamics after taking the logarithm of the cell populations in the first graph.Figure 2
The figure shows the CD4 cells and HIV virus population dynamics before therapeutic intervention and whenτ=0,1.5, and 2 days. The other parameters and initial conditions are given in Tables 1 and 2.From the simulations, it is clear that in the primary stage of the infection (period before treatment), a dramatic decrease in the level of the CD4-T cells occurs and the number of the free virons increases with time. With the introduction of intracellular delay, the virus population drops as well as an increase in the CD4, cells but then they stabilize at some point and coexist in the host as shown in Figure2.


## 2.1. The Probability Generating Function

The probability generating function of(X(t),Y(t),V(t)) is defined by
(5)G(z1,z2,z3,t)=∑x=0∞∑y=0∞∑v=0∞Px,y,v(t)z1xz2yz3v.
Differentiating (5) with respect to t yields
(6)∂G(z1,z2,z3,t)∂t=∑x=0∞∑y=0∞∑v=0∞Px,y,v′(t)z1xz2yz3v.
Differentiating again (5) with respect to z1,z2, and z3 yields
(7)∂3G(z1,z2,z3,t)∂z1∂z2∂z3=∑x=1∞∑y=1∞∑v=1∞xyvPx,y,v(t)z1x-1z2y-1z3v-1=∑x=0∞∑y=0∞∑v=0∞(x+1)(y+1)(v+1)Px+1,y+1,v+1(t)z1xz2yz3v.
Multiplying (3) by z1xz2yz3v and summing over x, y, and v, then applying (4), (5), (6), and (7) and on simplification we obtain
(8)∂G∂t={(z1-1)λ+(z3-1)γ}G+(1-z1)δ∂G∂z1+(z3-z2)κN∂G∂z2+(1-z3)μ∂G∂z3+βe-ρτ(z2-z1z3)∂2G∂z1∂z3.
This is called Lagrange partial differential equation for the probability generating function (pgf).Attempt to solve (8) gave us the following solution:
(9)G(z1,z2,z3,t)=aebt{∂2F(z1,z2,z3)∂z1∂z3{(z1-1)λ+(z3-1)γ}F(z1,z2,z3)aebt+(1-z1)δ∂F(z1,z2,z3)∂z1aebt+(Nz3-z2)κ∂F(z1,z2,z3)∂z2aebt+(1-z3)μ∂F(z1,z2,z3)∂z3aebt+β(e-ρτz2-z1z3)∂2F(z1,z2,z3)∂z1∂z3},
where a and b are constants.Equation (9) is not solvable, even for any simple form of F(z1,z2,z3). However, it is possible to obtain the moment structure of (X(t);Y(t);V(t)) from (8).


## 2.2. The Marginal Generating Functions

Recall that(10)G(z1,1,1,t)=∑x=0∞∑y=0∞∑v=0∞‍Px,y,v(t)z1x.
Assuming that z2=z3=1, z1=z3=1, and z2=z1=1 and solving (8), we obtain the marginal partial generating functions for X(t), Y(t), and V(t), respectively,
(11)∂G(z1;t)∂t=∂G(z1,1,1;t)∂t=(z1-1)λG+(1-z1)δ∂G∂z1+βe-ρτ(1-z1)∂2G∂z1∂z3,∂G(z2;t)∂t=∂G(1,z2,1;t)∂t=(1-z2)κN∂G∂z2+βe-ρτ(z2-1)∂2G∂z1∂z3,∂G(z3;t)∂t=∂G(1,1,z3;t)∂t=(z3-1)γG+(z3-1)κN∂G∂z2+(1-z3)μ∂G∂z3+βe-ρτ(1-z3)∂2G∂z1∂z3.


## 2.3. Numbers of CD4 T Cells and the Virons

As we know from probability generating function,(12)∂Gx∂z=∑x=0∞xPx(t)zx-1.
Letting z=1, we have
(13)∂Gx∂z|z=1=∑x=0∞xPx(t)zx-1=E[X].
Differentiating the partial differential equations of the pgf, we get the moments of X(t), Y(t), and V(t).Differentiating (11) with respect to z1, z2, and z3, respectively, and setting z1=z2=z3=1, we have
(14)∂∂tE[X(t)]=λ-δE[X(t)]-βE[X(t)V(t)],∂∂tE[Y(t)]=-κE[Y(t)]+βe-ρτE[X(t)V(t)],∂∂tE[V(t)]=γ+NκE[Y(t)]-μE[V(t)]-βE[X(t)V(t)].
Therefore, the moments of (X(t),Y(t),V(t)) from the pgf before treatment are as follows:
(15)∂∂tE[X(t)]=λ-δE[X(t)]-βE[X(t)V(t)],∂∂tE[Y(t)]=-κE[Y(t)]+βe-ρτE[X(t)V(t)],∂∂tE[V(t)]=γ+NκE[Y(t)]-μE[V(t)]-βE[X(t)V(t)].
The corresponding deterministic model of HIV-host interaction as formulated in [24] is given as follows:
(16)dxdt=λ-δx(t)-βx(t)v(t),dydt=βe-ρτx(t-τ)v(t-τ)-κy(t),dvdt=γ+Nκy(t)-μv(t)-βx(t)v(t).
Comparing system of (15) with the system of (16), we see that expected values of the multivariate Markov process [X(t),Y(t),V(t)] satisfies the corresponding deterministic model of the HIV-host interaction dynamics.


### 2.3.1. Simulation

Using the parameter values and initial conditions defined in Table1, we illustrate the general dynamics of the CD4-T cells and HIV virus for model (15) during infection and in the absence of treatment.The second graph in Figure2 is the population dynamics after taking the logarithm of the cell populations in the first graph.Figure 2
The figure shows the CD4 cells and HIV virus population dynamics before therapeutic intervention and whenτ=0,1.5, and 2 days. The other parameters and initial conditions are given in Tables 1 and 2.From the simulations, it is clear that in the primary stage of the infection (period before treatment), a dramatic decrease in the level of the CD4-T cells occurs and the number of the free virons increases with time. With the introduction of intracellular delay, the virus population drops as well as an increase in the CD4, cells but then they stabilize at some point and coexist in the host as shown in Figure2.


## 2.3.1. Simulation

Using the parameter values and initial conditions defined in Table1, we illustrate the general dynamics of the CD4-T cells and HIV virus for model (15) during infection and in the absence of treatment.The second graph in Figure2 is the population dynamics after taking the logarithm of the cell populations in the first graph.Figure 2
The figure shows the CD4 cells and HIV virus population dynamics before therapeutic intervention and whenτ=0,1.5, and 2 days. The other parameters and initial conditions are given in Tables 1 and 2.From the simulations, it is clear that in the primary stage of the infection (period before treatment), a dramatic decrease in the level of the CD4-T cells occurs and the number of the free virons increases with time. With the introduction of intracellular delay, the virus population drops as well as an increase in the CD4, cells but then they stabilize at some point and coexist in the host as shown in Figure2.


## 3. HIV and CD4 Cells Dynamics under Therapeutic Intervention

Assume that at timet=0, a combination therapy treatment is initiated in an HIV-infected individual. We assume that the therapeutic intervention inhibits either the enzyme action of reverse transcriptase or that of the protease of HIV in an HIV-infected cell. An HIV-infected cell with the inhibited HIV-transcriptase may be considered a dead cell as it cannot participate in the production of the copies of any type of HIV. On the other hand, an HIV-infected cell in which the reverse transcription has already taken place and the viral DNA is fused with the DNA of the host, but the enzyme activity of HIV-protease is inhibited, undergoes a lysis releasing infectious free HIV and noninfectious free HIV. A noninfectious free HIV cannot successfully infect a CD4 cell. Accordingly, at any time t, the blood of the infected person contains virus producing HIV-infected cells, infectious free HIV, and noninfectious free HIV. A typical life cycle of HIV virus and immune system interaction with therapeutic intervention is shown in Figure 3.Figure 3
HIV-host interaction with treatment.Introducing the effect of treatment, the Lagrange partial differential equation becomes(17)∂G∂t={(z1-1)λ+(z3-1)γ}G+(1-z1)δ∂G∂z1+(1-ω)(z3-z2)κN∂G∂z2+(1-z3)μ∂G∂z3+(1-α)βe-(1-α)ρτ(z2-z1z3)∂2G∂z1∂z3.


### 3.1. The Marginal Generating Functions

Recall that(18)G(z1,1,1,t)=∑x=0∞∑y=0∞∑v=0∞Px,y,v(t)z1x.
Setting z2=z3=1,  z1=z3=1, and z2=z1=1 and solving (17), we obtain the marginal partial generating functions for X(t), Y(t), and V(t), respectively, as:
(19)∂G(z1;t)∂t=∂G(z1,1,1;t)∂t=(z1-1)λG+(1-z1)δ∂G∂z1+(1-α)βe-(1-α)ρτ(1-z1)∂2G∂z1∂z3,∂G(z2;t)∂t=∂G(1,z2,1;t)∂t=(1-ω)(N-z2)κ∂G∂z2+(1-α)βe-(1-α)ρτ(z2-1)∂2G∂z1∂z3,∂G(z3;t)∂t=∂G(1,1,z3;t)∂t=(z3-1)γG+(1-ω)(z3-1)κN∂G∂z2+(1-z3)μ∂G∂z3+(1-α)βe-(1-α)ρτ(1-z3)∂2G∂z1∂z3.


### 3.2. Numbers of CD4+ T Cells and Virons under Therapeutic Intervention

From probability generating function one gets(20)∂Gx∂z=∑x=0∞xPx(t)zx-1.
Letting z=1, we have the expected number of target CD4+ T cells X(t) as follows:
(21)E[X(t)]=∂Gx∂z|z=1=∑x=0∞xPx(t)zx-1.Differentiating the partial differential equations of the pgf, we get the moments ofX(t), Y(t), and V(t).Differentiating (19) with respect to z1, z2, and z3, respectively, and setting z1=z2=z3=1, we have
(22)∂∂tE[X(t)]=λ-δE[X(t)]-(1-α)βE[X(t)V(t)],∂∂tE[Y(t)]=-κE[Y(t)]+(1-α)βe-(1-α)ρτE[X(t)V(t)],∂∂tE[V(t)]=γ+(1-ω)NκE[Y(t)]-μE[V(t)]-(1-α)βE[X(t)V(t)].
Therefore, the moments of (X(t),Y(t),V(t)) from the pgf with therapeutic intervention are
(23)∂∂tE[X(t)]=λ-δE[X(t)]-(1-α)βE[X(t)V(t)],∂∂tE[Y(t)]=-κE[Y(t)]+(1-α)βe-(1-α)ρτE[X(t)V(t)],∂∂tE[V(t)]=γ+(1-ω)NκE[Y(t)]-μE[V(t)]-(1-α)βE[X(t)V(t)].


#### 3.2.1. Simulation

Using the parameter values and initial conditions defined in Table1, we illustrate the general dynamics of the CD4-T cells and HIV virus for model (23) with therapeutic intervention and test the effect of intracellular delay and drug efficacy (perform sensitivity analysis).With60% drug efficacy, the virus stabilizes and coexists with the CD4 cells within the host as shown in the first graph in Figure 4.Figure 4
The figure shows the CD4 cells and HIV virus population dynamics with drug efficacy of60% and τ=0,0.5, and 1 days. The other parameters and initial conditions are given in Tables 1 and 2.Introducing intracellular time delay,τ=0.5, the CD4 cells increase and the virus population drops then stabilizes and again coexists within the host as illustrated in the second graph in Figure 4.Forτ=1 and with 60% drug efficacy, the dynamics change as shown in the last graph in Figure 4.We now analyze drug effectiveness on the cell populations.Figure5 shows that, with improved HIV drug efficacy, a patient on treatment will have low, undetectable viral load with time. It also shows that the protease inhibitor drug efficacy is very important in clearing the virus. Also the figure shows that a combination of therapeutic intervention and intracellular delay is very important in lowering the viral load in an HIV-infected person.Figure 5
Shows the CD4 cells and HIV virus population dynamics withτ=0.5 days and different levels of drug efficacy. The other parameters and initial conditions are given in Tables 1 and 2.


### 3.3. The Probability of HIV Clearance

We now calculate the distribution of times to extinction for the virons reservoir. If we assume the drug given at fixed intervals to sustain its efficacy to be effective in producing noninfectious virus, then we can clear the infectious virus. Using reverse transcriptase (ART), the infected cell can be forced to become latently infected (nonvirus producing cell) hence clearing the virus producing cell reservoir. If we assume that no newly infected cells become productively infected in the short timeτ(e-ρτ=0) or that treatment is completely effective (ω=1), we can obtain the extinction probability analytically. In this case, the infectious virus cell dynamics decouples from the rest of the model and can be represented as a pure immigration-and-death process with master equation
(24)Pv′(t)=-(γ+κ(1-ω)N)Pv(t)-v(μ+(1-α)e-ρτβ)Pv(t)+(v-1)(γ+κ(1-ω)N)Pv-1(t)+(v+1)(μ+(1-α)e-ρτβ)Pv+1(t),
where Pv(t) is the probability that, at time t, there are v HIV particles. This probability has the conditional probability generating function
(25)Gv(z,t)∣V(0)=v0=exp{θϵ(z-1)(1-e-θt)}{ze-θt+1-e-θt}v0,
where v0 is the initial virus reservoir size, θ=μ+(1-α)βe-ρτ and ϵ=γ+(1-ω)κN. We noticed that this is a pgf of a random variable with a product of Poisson distribution exp{(θ/ϵ)(z-1)(1-e-θt)} with mean (θ/ϵ)(1-e-θt) and a binomial distribution {ze-θt+1-e-θt}v0.The probability of this population going extinct att or before time t is given by
(26)pext(t)∣V(0)=v0=P(V=0,t)∣V(0)=v0=Gv(0,t)=P0(t)=exp{θϵ(e-θt-1)}{1-e-θt}v0.
The probability of extinction is the value of Gv(z,t) when t→∞, that is,
(27)pext=P0(∞)=limt→∞(exp{θϵ(e-θt-1)}{1-e-θt}v0)=e-θ/ϵ=e-((μ+(1-α)βe-ρτ)/(γ+(1-ω)κN)).
From (27), it is evident that probability of clearance of HIV is affected by the combination of drug efficacy and intracellular delay, death of the virons and education (counseling the HIV patients on the risk of involvement in risk behaviors).


## 3.1. The Marginal Generating Functions

Recall that(18)G(z1,1,1,t)=∑x=0∞∑y=0∞∑v=0∞Px,y,v(t)z1x.
Setting z2=z3=1,  z1=z3=1, and z2=z1=1 and solving (17), we obtain the marginal partial generating functions for X(t), Y(t), and V(t), respectively, as:
(19)∂G(z1;t)∂t=∂G(z1,1,1;t)∂t=(z1-1)λG+(1-z1)δ∂G∂z1+(1-α)βe-(1-α)ρτ(1-z1)∂2G∂z1∂z3,∂G(z2;t)∂t=∂G(1,z2,1;t)∂t=(1-ω)(N-z2)κ∂G∂z2+(1-α)βe-(1-α)ρτ(z2-1)∂2G∂z1∂z3,∂G(z3;t)∂t=∂G(1,1,z3;t)∂t=(z3-1)γG+(1-ω)(z3-1)κN∂G∂z2+(1-z3)μ∂G∂z3+(1-α)βe-(1-α)ρτ(1-z3)∂2G∂z1∂z3.


## 3.2. Numbers of CD4+ T Cells and Virons under Therapeutic Intervention

From probability generating function one gets(20)∂Gx∂z=∑x=0∞xPx(t)zx-1.
Letting z=1, we have the expected number of target CD4+ T cells X(t) as follows:
(21)E[X(t)]=∂Gx∂z|z=1=∑x=0∞xPx(t)zx-1.Differentiating the partial differential equations of the pgf, we get the moments ofX(t), Y(t), and V(t).Differentiating (19) with respect to z1, z2, and z3, respectively, and setting z1=z2=z3=1, we have
(22)∂∂tE[X(t)]=λ-δE[X(t)]-(1-α)βE[X(t)V(t)],∂∂tE[Y(t)]=-κE[Y(t)]+(1-α)βe-(1-α)ρτE[X(t)V(t)],∂∂tE[V(t)]=γ+(1-ω)NκE[Y(t)]-μE[V(t)]-(1-α)βE[X(t)V(t)].
Therefore, the moments of (X(t),Y(t),V(t)) from the pgf with therapeutic intervention are
(23)∂∂tE[X(t)]=λ-δE[X(t)]-(1-α)βE[X(t)V(t)],∂∂tE[Y(t)]=-κE[Y(t)]+(1-α)βe-(1-α)ρτE[X(t)V(t)],∂∂tE[V(t)]=γ+(1-ω)NκE[Y(t)]-μE[V(t)]-(1-α)βE[X(t)V(t)].


### 3.2.1. Simulation

Using the parameter values and initial conditions defined in Table1, we illustrate the general dynamics of the CD4-T cells and HIV virus for model (23) with therapeutic intervention and test the effect of intracellular delay and drug efficacy (perform sensitivity analysis).With60% drug efficacy, the virus stabilizes and coexists with the CD4 cells within the host as shown in the first graph in Figure 4.Figure 4
The figure shows the CD4 cells and HIV virus population dynamics with drug efficacy of60% and τ=0,0.5, and 1 days. The other parameters and initial conditions are given in Tables 1 and 2.Introducing intracellular time delay,τ=0.5, the CD4 cells increase and the virus population drops then stabilizes and again coexists within the host as illustrated in the second graph in Figure 4.Forτ=1 and with 60% drug efficacy, the dynamics change as shown in the last graph in Figure 4.We now analyze drug effectiveness on the cell populations.Figure5 shows that, with improved HIV drug efficacy, a patient on treatment will have low, undetectable viral load with time. It also shows that the protease inhibitor drug efficacy is very important in clearing the virus. Also the figure shows that a combination of therapeutic intervention and intracellular delay is very important in lowering the viral load in an HIV-infected person.Figure 5
Shows the CD4 cells and HIV virus population dynamics withτ=0.5 days and different levels of drug efficacy. The other parameters and initial conditions are given in Tables 1 and 2.


## 3.2.1. Simulation

Using the parameter values and initial conditions defined in Table1, we illustrate the general dynamics of the CD4-T cells and HIV virus for model (23) with therapeutic intervention and test the effect of intracellular delay and drug efficacy (perform sensitivity analysis).With60% drug efficacy, the virus stabilizes and coexists with the CD4 cells within the host as shown in the first graph in Figure 4.Figure 4
The figure shows the CD4 cells and HIV virus population dynamics with drug efficacy of60% and τ=0,0.5, and 1 days. The other parameters and initial conditions are given in Tables 1 and 2.Introducing intracellular time delay,τ=0.5, the CD4 cells increase and the virus population drops then stabilizes and again coexists within the host as illustrated in the second graph in Figure 4.Forτ=1 and with 60% drug efficacy, the dynamics change as shown in the last graph in Figure 4.We now analyze drug effectiveness on the cell populations.Figure5 shows that, with improved HIV drug efficacy, a patient on treatment will have low, undetectable viral load with time. It also shows that the protease inhibitor drug efficacy is very important in clearing the virus. Also the figure shows that a combination of therapeutic intervention and intracellular delay is very important in lowering the viral load in an HIV-infected person.Figure 5
Shows the CD4 cells and HIV virus population dynamics withτ=0.5 days and different levels of drug efficacy. The other parameters and initial conditions are given in Tables 1 and 2.


## 3.3. The Probability of HIV Clearance

We now calculate the distribution of times to extinction for the virons reservoir. If we assume the drug given at fixed intervals to sustain its efficacy to be effective in producing noninfectious virus, then we can clear the infectious virus. Using reverse transcriptase (ART), the infected cell can be forced to become latently infected (nonvirus producing cell) hence clearing the virus producing cell reservoir. If we assume that no newly infected cells become productively infected in the short timeτ(e-ρτ=0) or that treatment is completely effective (ω=1), we can obtain the extinction probability analytically. In this case, the infectious virus cell dynamics decouples from the rest of the model and can be represented as a pure immigration-and-death process with master equation
(24)Pv′(t)=-(γ+κ(1-ω)N)Pv(t)-v(μ+(1-α)e-ρτβ)Pv(t)+(v-1)(γ+κ(1-ω)N)Pv-1(t)+(v+1)(μ+(1-α)e-ρτβ)Pv+1(t),
where Pv(t) is the probability that, at time t, there are v HIV particles. This probability has the conditional probability generating function
(25)Gv(z,t)∣V(0)=v0=exp{θϵ(z-1)(1-e-θt)}{ze-θt+1-e-θt}v0,
where v0 is the initial virus reservoir size, θ=μ+(1-α)βe-ρτ and ϵ=γ+(1-ω)κN. We noticed that this is a pgf of a random variable with a product of Poisson distribution exp{(θ/ϵ)(z-1)(1-e-θt)} with mean (θ/ϵ)(1-e-θt) and a binomial distribution {ze-θt+1-e-θt}v0.The probability of this population going extinct att or before time t is given by
(26)pext(t)∣V(0)=v0=P(V=0,t)∣V(0)=v0=Gv(0,t)=P0(t)=exp{θϵ(e-θt-1)}{1-e-θt}v0.
The probability of extinction is the value of Gv(z,t) when t→∞, that is,
(27)pext=P0(∞)=limt→∞(exp{θϵ(e-θt-1)}{1-e-θt}v0)=e-θ/ϵ=e-((μ+(1-α)βe-ρτ)/(γ+(1-ω)κN)).
From (27), it is evident that probability of clearance of HIV is affected by the combination of drug efficacy and intracellular delay, death of the virons and education (counseling the HIV patients on the risk of involvement in risk behaviors).


## 4. Discussion and Recommendation

In this study, we derived and analyzed a stochastic model for in-host HIV dynamics that included combined therapeutic treatment and intracellular delay between the infection of a cell and the emission of viral particles. This model included dynamics of three compartments—the number of healthy CD4 cells, the number of infected CD4 cells, and the HIV virons—and it described HIV infection of CD4 T cells before and during therapy. We derived equations for the probability generating a function and using numerical techniques. In this paper we showed the usefulness of our stochastic approach towards modeling HIV dynamics by obtaining moment structures of the healthy CD4+ cell and the virus particles over timet. We simulated the mean number of the healthy CD4 cell, the infected cells, and the virus particles before and after combined therapeutic treatment at any time t. We will emphasize further usefulness of stochastic models in HIV dynamics in our future research.Our analysis during treatment shows that, when it is assumed that the drug is not completely effective, as it is the case of HIVin vivo, the predicted rate of decline in plasma HIV virus concentration depends on three factors: the death rate of the virons, the efficacy of therapy, and the length of the intracellular delay. Our model produces an interesting feature that the successfully treated HIV patients will have low, undetectable viral load. We conclude that to control the concentrations of the virus and the infected cells in HIV-infected person, a strategy should aim to improve the cure rate (drug efficacy) and also to increase the intracellular delay τ. Therefore, the efficacy of the protease inhibitor and the reverse transcriptase inhibitor and also the intracellular delay play crucial role in preventing the progression of HIV.The extinction probability model showed that the time it takes to have low, undetectable viral load (infectious virus) in an HIV-infected patient depends on the combination of drug efficacy and intracellular delay and also education of the infected patients. In our work, the dynamics of mutant virus were not considered, and also our study included dynamics of only three compartments (healthy CD4 cell, infected CD4 cells, and infectious HIV virus particles) of which extensions are recommended for further extensive research. In a follow-up work, we intend to obtain real data in order to test the efficacy of our models as we have done here with simulated data.



---

*Source: 103708-2013-04-29.xml*