# A Stochastic Flows Approach for Asset Allocation with Hidden Economic Environment

Authors: Tak Kuen Siu
Journal: International Journal of Stochastic Analysis
 (2015)

---

## Abstract

An optimal asset allocation problem for a quite general class of utility functions is discussed in a simple two-state Markovian regime-switching model, where the appreciation rate of a risky share changes over time according to the state of a hidden economy. As usual, standard filtering theory is used to transform a financial model with hidden information into one with complete information, where a martingale approach is applied to discuss the optimal asset allocation problem. Using a martingale representation coupled with stochastic flows of diffeomorphisms for the filtering equation, the integrand in the martingale representation is identified which gives rise to an optimal portfolio strategy under some differentiability conditions.


---

## Body

## 1. Introduction

The optimal asset allocation problem has long been an important topic in financial economics. From the practical perspective, the problem may be of importance to investment managers in banks, financial institutions, hedge funds, insurance companies, and pension funds. The problem may also be of interest to individual investors and policyholders of defined contribution pension funds. A scientific approach to the optimal asset allocation problem was pioneered by Markowitz [1]. In the Markowitz paradigm, a single-period model was considered and the problem was formulated as a mean-variance optimization problem. Merton [2, 3] pioneered the study of the optimal asset allocation problem based on the maximization of an expected utility in a continuous-time economy. Using dynamic programming, Merton derived a Hamilton-Jacobi-Bellman (HJB) equation governing the value function of the problem under some differentiability conditions. For a particular class of utility functions, say a power utility, Merton obtained a closed-form expression for an optimal portfolio strategy which is known as the Merton ratio.Pliska [4], Karatzas et al. [5], and Cox and Huang [6] pioneered an alternative approach to the optimal asset allocation problem in continuous time. This approach is known as the martingale approach. The key idea of the martingale approach is not unlike that of a risk-neutral valuation of a contingent claim. Firstly, an equivalent martingale measure under which the discounted optimal wealth process is a martingale is determined. Then, the integrand in a martingale representation of the discounted optimal wealth process is used to identify an optimal portfolio process. For discussions on the martingale approach, one may refer to, for example, Cvitanic and Karatzas [7], Karatzas and Shreve [8], Elliott and Kopp [9], and Pham [10]. Gerber and Shiu [11] considered an approach based on a tool used in actuarial science, namely, the Esscher transform, to discuss the optimal asset allocation problem. This approach is related to the martingale approach; see the discussion by Boyle [12].Recently, the optimal asset allocation problem in Markovian regime-switching models has received some attention in the literature. The rationale of considering the problem in Markovian regime-switching models is to incorporate the impact of structural changes in economic conditions on price dynamics and investment decision making. Some works on the optimal asset allocation problem in Markovian regime-switching models are in, for example, Zhou and Yin [13], Yin and Zhou [14], Sass and Haussmann [15], Baeuerle and Rieder [16], Jang et al. [17], Nagai and Runggaldier [18], Sotomayor and Cadenillas [19], Zhang et al. [20], Elliott and Siu [21], Elliott et al. [22], Korn et al. [23], Siu [24–26], Shen and Siu [27], and others. Both situations where the modulating Markov chain is observable and where it is hidden were considered. Different approaches to stochastic optimal control such as the HJB dynamic programming approach, the martingale approach (coupled with Malliavin calculus), and the backward stochastic differential equation approach were adopted.In this paper we study an optimal asset allocation problem for a quite general class of utility functions in a simple two-state Markovian regime-switching model. We suppose that the appreciation rate of a risky share changes over time according to the state of a hidden economy. The evolution of the two-state hidden economy over time is assumed to be governed by a continuous-time, two-state, hidden Markov chain, where the two states may be interpreted as “Expansion” and “Recession.” As usual, the optimal asset allocation problem is discussed in two steps. Firstly, standard filtering theory is adopted to turn an economy with hidden information into one with complete information. The latter is called a “filtered” economy and is complete. That is, in the “filtered” economy, there is a unique equivalent martingale measure. A martingale approach is then used to discuss the optimal asset allocation problem in the “filtered” economy. Using a martingale representation coupled with stochastic flows of diffeomorphisms for the filtering equation, the integrand in the martingale representation is identified which gives rise to an optimal portfolio strategy under some differentiability conditions. A partial differential equation for the optimal wealth conditioning on the values of the underlying state variables is also obtained. This may be called an optimal wealth function which characterises a functional relationship between the current optimal wealth and the current values of the underlying state variables. The approach adopted in this paper can be used in a generalN-state case. However, it seems that, in the two-state case, the results of the filters and the partial differential equation for the optimal wealth are neater than those arising from the N-state case. Indeed, the two-state case may not be without practical relevance. Taylor [28, 29] provided some discussions on the practical relevance of using a two-state Markovian regime-switching process for modeling financial returns.The rest of the paper is structured as follows. The next section presents the model dynamics in the original economy with hidden information and in the “filtered” economy. In Section3, the optimal asset allocation problem in the “filtered” economy is presented and the martingale approach is used for solving the problem. The use of stochastic flows to identify the integrand in the martingale representation in the filtered market is then presented in Section 4. The final section gives a summary and suggests some possible topics for further research.


## 2. Model Dynamics and Filtering

The modelling and filtering frameworks presented here are standard in the literature on optimal asset allocation in a hidden Markovian regime-switching model; see, for example, Siu [24–26], Korn et al. [23], Wei et al. [30], and Elliott and Siu [21], amongst others.A continuous-time economy with two primitive securities, namely, a bond and a risky share, is considered. As usual, uncertainty in the economy is described by a complete probability space(Ω,F,P), where P is a real-world probability measure. The time parameter set of the economy is given by a finite time horizon T:=[0,T], where T<∞. The evolution of the state of a hidden economy over time is modeled by a continuous-time, two-state, hidden Markov chain Xt∣t∈T on (Ω,F,P). The state space of the chain is taken to be {e1,e2}, where e1=1,0′∈R2 and e2=0,1′∈R2. y′ is the transpose of a vector or a matrix y. The state space {e1,e2} is called the canonical state space of the chain and was adopted in Elliott et al. [31]. The states “e1” and “e2” may be interpreted as “Expansion” and “Recession” of an economy, respectively. As usual, the probability laws of the chain are specified by its intensity matrix, or rate matrix, which is defined as
(1)A:=-a1a1a2-a2,
where a1,a2>0.A two-state Markovian regime-switching model for asset price dynamics may be justified both theoretically and empirically (see Taylor [28, 32]). Indeed, Taylor [29] pointed out that a two-state Markov chain is sufficient to distinguish a good economy from an economy experiencing distresses.Letr be the constant continuously compounded rate of interest of the bond, where r>0. Then the evolution of the bond price over time is governed by
(2)B(t)=ert,B(0)=1.For eacht∈T, let μ(t) be the appreciation rate of the risky share at time t. Again it is supposed that μ(t) is modulated by the chain as
(3)μt=μ,Xt,
where μ:=μ1,μ2′∈R2; μ1 and μ2 are the appreciation rates of the risky share when the economy is in an expansion and when it is in a recession, respectively, where μ1>μ2; ·,· is the scalar product in R2; since the chain Xt∣t∈T is hidden, the appreciation rate μ(t) defined as above is unobservable.Letσ be the constant volatility of the risky share, where σ>0, and Wt∣t∈T is a standard Brownian motion on (Ω,F,P). Then we suppose that under P the evolution of the price of the risky share over time is governed by
(4)dS(t)=μ(t)S(t)+σS(t)dW(t),S(0)=s0∈(0,∞).
Note that if one considers a general situation where the volatility is modulated by the hidden Markov chain as well, one may need to take into account some potential issues. Firstly, standard filtering theory may not be conveniently used to turn the economy with hidden states into one with observable states. Secondly, since σ is completely identified by the predictable quadratic variation of the price process of the risky share, it should be observable. Thirdly, an exact, finite-dimensional filtering equation for the hidden Markov chain may be difficult, if not impossible, to derive if the volatility is also modulated by the hidden Markov chain. One may refer to, for example, Guo [33], Gerber and Shiu [34], Siu [24], and Elliott and Siu [21], for related discussions.Note that the price processSt∣t∈T of the risky share is observable. However, both the drift process μt∣t∈T and the Brownian motion Wt∣t∈T are unobservable.In what follows, we will adopt standard filtering theory to turn the economy with hidden states into one with observable states.Firstly the information structure is specified. LetF:=Ft∣t∈T be the right-continuous and P-complete filtration generated by the price process St∣t∈T of the risky share. This describes the flow of observable market information. Let FX:=FXt∣t∈T be the right-continuous, P-complete filtration generated by the chain X. For each t∈T, let
(5)G(t):=FX(t)∨F(t),
where A∨B is the minimal σ-field containing both σ-fields  A and B. Write G:=Gt∣t∈T.For any integrable,G-adapted, process, ϕt∣t∈T, let ϕ^t∣t∈T be its F-optional projection under P. Then, for each t∈T,
(6)ϕ^t=Eϕt∣Ft,P-a.s.
Here E is the expectation operator under P. It is known that the optional projection takes into account the measurability in (t,ω)∈T×Ω.Define, for eacht∈T,
(7)p(t):=X^(t),e1=PXt=e1∣Ft.
This is the conditional, or posterior, probability that the hidden economy is in an expansion at time t given the observable information up to time t. We suppose that p(0)=p0, where p0 is a given constant taking a value in (0,1).Define the processW^t∣t∈T by putting
(8)W^(t):=W(t)+∫0t‍μu-μ1pu-μ21-puσdu.
Then it was shown in Lipster and Shiryaev [35] that W^t∣t∈T is an (F,P)-standard Brownian motion. This is called the innovations process.Then the following lemma was due to, for example, Lipster and Shiryaev [35] and Elliott [36] (see Chapter 18 therein).Lemma 1.
Letρ:=μ1-μ2/σ. Then, under P, the conditional probability process pt∣t∈T is governed by the following stochastic differential equation:
(9)dpt=-a1pt+a21-ptdt+ρ1-ptp(t)dW^(t),p(0)=p0∈(0,1).UnderP, the price process St∣t∈T of the risky share can be expressed in terms of W^t∣t∈T as follows:
(10)dS(t)=[μ2+(μ1-μ2)p(t)]S(t)dt+σS(t)dW^(t).
Note that
(11)μ^(t)=μ,X^t=μ1p(t)+μ21-pt.
Then, under P,
(12)dS(t)=μ^(t)S(t)dt+σS(t)dW^(t).
This is used as the price process of the risky share in a “filtered” economy with complete observations. It is clear that the filtered economy is complete.


## 3. Martingale Approach for Asset Allocation

The aim of this section is to adapt the martingale approach to optimal asset allocation in the “filtered” economy described in the last section. The martingale approach to optimal asset allocation was pioneered by Pliska [4], Karatzas et al. [5], and Cox and Huang [6]. The mathematical basis of this approach is the martingale method for stochastic optimal control which was pioneered by Rishel [37], Duncan and Varaiya [38, 39], and Davis [40]. The martingale approach has been used to discuss optimal asset allocation problems in some filtered financial models (see, e.g., Sass and Haussmann [15], Korn et al. [23], and Siu [24] and the relevant references therein). In this section, the classical convex dual arguments in, for example, Karatzas and Shreve [8], Pham [10], and Cvitanic and Karatzas [7], will be used. Unlike the Lagrange multiplier arguments, the classical convex dual arguments do not require the change of order of differentiation and integration (The author would like to thank the referee for pointing out this.). The developments here are standard and follow those in Cvitanic and Karatzas [7] (Section 7 therein).Recall that, in the “filtered” model, the price process of the risky share underP is given by
(13)dS(t)=μ^(t)S(t)dt+σS(t)dW^(t).
Furthermore, under P, the filtering equation is given by
(14)dpt=[-a1p(t)+a2(1-p(t))]dt+ρ(1-p(t))p(t)dW^(t),
where p(0)=p0∈(0,1).Letπt∣t∈T be a portfolio process, where π(t) is the amount of money invested in the risky share held at time t. Suppose that πt∣t∈T is self-financing. Then, under P, the wealth process Vπt∣t∈T corresponding to the self-financing portfolio process πt∣t∈T is governed by
(15)dVπ(t)=rVπt+πtμ^t-rdt+π(t)σdW^(t).
To simplify the notation, the superscript π is suppressed and write V(t) for Vπ(t) unless otherwise stated. The initial wealth V(0)=v0∈(0,∞).Then, as usual, an admissible portfolio process is defined as follows.Definition 2.
A portfolio processπt∣t∈T is said to be admissible with respect to the initial wealth v0∈(0,∞) and the initial state p0∈(0,1) (i.e., πt∣t∈T∈A(v0,p0)), if it satisfies the following conditions: (1)
πt∣t∈T is self-financing;(2)
πt∣t∈T is a measurable, F-adapted process such that
(16)∫0Tπ(t)2‍dt<∞,P-a.s;(3)
for eacht∈T, V(t):=V(t,ω)≥0, for almost all (t,ω)∈T×Ω;(4)
hence(17)∫0T‍rVt+πtμ^t-rdt<∞,P-a.s;(5)
the stochastic differential equation governing the wealth processVt∣t∈T has a unique strong solution.Consider now a utility functionU:(0,∞)→R such that it satisfies the following standard conditions:(1)
U∈C1((0,∞)), where C1((0,∞)) is the space of continuously differentiable functions on (0,∞);(2)
U is strictly increasing and strictly concave;(3)
the derivativeU′ of U is such that
(18)lim⁡v→∞U′(v)=0,lim⁡v→0+U′(v)=∞.Define(19)A1(v0,p0):=π∈Av0,p0∣EU-VT<∞,
where U- is the negative part of U.Then for each portfolio processπ∈A1(v0,p0), initial wealth v0∈(0,∞), and initial information state p0∈(0,1), the performance functional J(π;v0,p0) is defined by
(20)J(π;v0,p0):=E[U(V(T))].
The objective of an economic agent is to select π∈A1(v0,p0) so as to maximize J(π;v0,p0), that is, to solve the following optimization problem:
(21)Φ(v0,p0):=sup⁡π∈A1(v0,p0)J(π;v0,p0),
where Φ(v0,p0) is the value of the optimization problem.Letθ^t∣t∈T be a bounded, F-predictable process defined by
(22)θ^t:=r-μ1σpt+r-μ2σ1-pt.
Consider the F-adapted process Λt∣t∈T defined by putting
(23)Λ(t):=exp⁡∫0t‍θ^udW^u-12∫0t‍θ^2udu.
Since θ^t∣t∈T is bounded, Λt∣t∈T is an (F,P)-exponential martingale. Consequently, E[Λ(T)]=1.A new probability measureQ equivalent to P on F(T) can then be defined by setting
(24)dQdPF(T):=Λ(T).
By Girsanov’s theorem, the process W^Qt∣t∈T defined by
(25)W^Q(t):=W^(t)-∫0t‍θ^(u)du
is an (F,Q)-standard Brownian motion.LetV~t∣t∈T be the discounted wealth process, where V~(t):=e-rtV(t) for each t∈T. Then, under Q,
(26)V~(t)=v0+∫0t‍πue-ruσdW^Q(u).
This is an (F,Q)-(local)-martingale. Indeed it is an (F,Q)-martingale.Note thatπ∈A1(v0,p0)⊂A(v0,p0), so V~t∣t∈T is bounded from below. Consequently, using the Fatou lemma, V~t∣t∈T is an (F,Q)-supermartingale (see Karatzas and Shreve [8], Page 92 therein). Then
(27)EQ[V~(T)]≤v0,
where EQ is the expectation operator under Q.SinceU is strictly concave, U′ is strictly decreasing. Consequently, there is an inverse map I:(0,∞)→(0,∞) of U′ which is also strictly decreasing. Furthermore, I(0+)=∞ and I(∞)=0. Define, for each γ∈(0,∞),
(28)Lγ:=Ee-rTΛTIγΛTe-rT.
Suppose that, for each γ∈(0,∞), L(γ)<∞. Then the function L:(0,∞)→(0,∞) is continuous and is strictly decreasing such that L(0+)=∞ and L(∞)=0. Let κ be the inverse of L. Define a positive, F(T)-measurable, integrable random variable ξ by putting
(29)ξ:=Iκv0ΛTe-rT.
Then the following lemma is a standard result and is a particular case of Lemma 7.2 in Cvitanic and Karatzas [7]. We state the result without giving the proof.Lemma 3.
The random variableξ defined in (29) satisfies
(30)E[e-rTΛ(T)ξ]=v0,EU-ξ<∞,
and, for all π∈A1(v0,p0),
(31)Jπ;v0,p0≤EUξ.The following theorem is a standard result and is a particular case of Proposition 7.3 in Cvitanic and Karatzas [7]. Note that the form of an optimal portfolio process is identified in the proof of the theorem, so we present the proof following that in Cvitanic and Karatzas [7].Theorem 4.
LetH be a positive, F(T)-measurable, integrable random variable such that
(32)E[e-rTΛ(T)H]=EQ[e-rTH]=v0<∞.
Then there exists a portfolio process π such that π∈A(v0,p0) and Vv0,π(T)=H,  P-a.s.Proof.
With a slight abuse of notation, we define a positive, continuous processVt∣t∈T by putting
(33)e-rtV(t)=EQe-rTH∣Ft,t∈T.
Then, from its definition, V(0)=v0 and V(T)=H,  P-a.s.
Define the following(F,Q)-martingale Mt∣t∈T by setting
(34)Mt:=EQe-rTH∣Ft=e-rtV(t)=V~(t),t∈T.
By the martingale representation theorem (see, e.g., Elliott [36], Theorem 12.33 therein), there exists an F-progressively measurable, real-valued process ψt∣t∈T satisfying ∫0T‍|ψ(t)|2dt,  P-a.s., such that
(35)M(t)=V~(t)=v0+∫0t‍ψ(u)dW^Q(t),P-a.s.
Comparing (26) and (35), the process Vt∣t∈T is the wealth process corresponding to the portfolio process π∈A(v0,p0), where the portfolio process π:=πt∣t∈T is given by
(36)π(t)=ψ(t)σe-rt,t∈T.The following corollary is a particular case of Theorem 7.4 in Cvitanic and Karatzas [7]. It is a direct consequence of Lemma 3 and Theorem 4.Corollary 5.
Supposeξ is defined in (29). Then there exists a portfolio process π*:=π*t∣t∈T such that π*∈A1(v0,p0), Vv0,π*(T)=ξ,  P-a.s., and Φ(v0,p0)=J(π*;v0,p0).From Corollary5, it is clear that the optimal terminal wealth is given by ξ defined in (29) and the corresponding admissible optimal portfolio process is given by π*, where π* is given in the proof of Theorem 4; that is,
(37)π*(t)=ψ(t)σe-rt,t∈T.
Consequently to determine the optimal portfolio process π*t∣t∈T, the integrand ψt∣t∈T in martingale representation (35) must be determined. In the next section the integrand ψt∣t∈T will be identified using the concept of stochastic flows of diffeomorphisms.


## 4. Stochastic Flows and Optimal Portfolio

In this section the stochastic flows of diffeomorphisms for the filtering equation will be first discussed. Then under some mild differentiability conditions the integrand in the martingale representation for the discounted optimal wealth process is identified which, in turn, gives rise to an expression for the optimal portfolio. The concept of stochastic flows of diffeomorphisms has been used for option pricing and hedging; see, for example, Colwell et al. [41], Colwell and Elliott [42], Elliott and Kopp [9], and Elliott et al. [43], amongst others.For eachz∈(0,1), let Zs,t(z) be the unique, strong solution of the filtering equation under P for t≥s with initial condition Zs,s(z)=z. That is,
(38)dZs,tz=-a1Zs,tz+a21-Zs,tzdt+ρ1-Zs,tzZs,t(z)dW^(t),Zs,s(z)=z.
Then using similar arguments in Kunita [44, 45] and Bismut [46] (see also, e.g., Elliott and Kopp [9]), there exists a flow of diffeomorphisms z→Zs,t(z) corresponding to the filtering equation. Write
(39)Ds,t(z):=∂Zs,t(z)∂z,
for the derivative of the map z→Zs,t(z).ThenDs,t(z) satisfies the following linearized stochastic differential equation:
(40)dDs,tz=-(a1+a2)Ds,t(z)dt+ρ1-2Zs,tzDs,tzdW^t,
with initial condition Ds,s(z)=1.Again using similar arguments in Kunita [44, 45] and Bismut [46] (see also, e.g., Elliott and Kopp [9]), the inverse Ds,t-1(z) of Ds,t(z) exists. Furthermore, Ds,t-1(z) satisfies the following equation:
(41)dDs,t-1z=Ds,t-1(z)(a1+a2)dt-Ds,t-1zρ1-2Zs,tzdW^(t)+Ds,t-1(z)ρ21-2Zs,t(z)2dt,
with initial condition Ds,s-1(z)=1.Write, for eachi=1,2,
(42)θi:=r-μiσ,
and, for each s,t∈T with s≤t,  z∈(0,1),
(43)Θs,t(z):=θ1Zs,t(z)+θ21-Zs,tz,
so that
(44)∂Θs,t(z)∂z=(θ1-θ2)Ds,t(z).Consider now the stochastic exponentialMs,t(z) defined by
(45)Ms,t(z)=1+∫st‍Θs,u(z)Ms,u(z)dW^(u).
Then
(46)Ms,t(z)=exp⁡∫st‍Θs,uzdW^u-12∫st‍Θs,u2zdu.
This is an (F,P)-martingale.The following lemma gives an expression for the derivative∂Mt,T(z)/∂z.Lemma 6.
Consider(47)∂Mt,T(z)∂z=Mt,T(z)∫tT‍(θ1-θ2)Dt,u(z)dW^Q(u).Proof.
Using similar arguments in Elliott et al. [43], Proposition 3.1, for example, the result can be verified by differentiation. Firstly, from the differentiability of the solution of stochastic differential equation (45),
(48)∂Mt,T(z)∂z=∫tT‍(θ1-θ2)Dt,u(z)Mt,u(z)dW^(u)+∫tT‍Θt,u(z)∂Mt,u(z)∂zdW^(u).
Then applying Itô’s differentiation rule to the product
(49)Mt,T(z)∫tT‍(θ1-θ2)Dt,u(z)dW^Q(u)
and using (45) give
(50)Mt,T(z)∫tT‍(θ1-θ2)Dt,u(z)dW^Q(u)=∫tT‍Mt,u(z)(θ1-θ2)Dt,u(z)(dW^(u)-Θt,u(z)du)+∫tT‍Mt,uz∫tu‍θ1-θ2Dt,szdW^Qs·Θt,u(z)dW^(u)+∫tT‍Mt,u(z)(θ1-θ2)Dt,u(z)Θt,u(z)du=∫tT‍Mt,u(z)(θ1-θ2)Dt,u(z)dW^(u)+∫tT‍Mt,uz∫tu‍θ1-θ2Dt,szdW^Qs·Θt,uzdW^u.
If
(51)∂Mt,u(z)∂z=Mt,u(z)∫tu‍(θ1-θ2)Dt,s(z)dW^Q(s),
then
(52)Mt,T(z)∫tT‍(θ1-θ2)Dt,u(z)dW^Q(u)=∫tT‍Mt,u(z)(θ1-θ2)Dt,u(z)dW^(u)+∫tT‍∂Mt,u(z)∂zΘt,u(z)dW^(u).
The result follows by noting that (48) has a unique solution.Define a functionF:T×(0,∞)×(0,1)→R by putting
(53)Ft,y,z:=EMt,Tze-rT×Iκv0yMt,Tze-rT∣Ft,
for each (t,y,z)∈T×(0,∞)×(0,1).Then we have the following lemma.Lemma 7.
IfM0,t(z0)=y and Z0,t(z0)=z, (y,z)∈(0,∞)×(0,1), then the discounted optimal wealth e-rtV*(t) at time t is given by
(54)e-rtV*(t)=F(t,y,z).Proof.
The proof is standard. Note that(55)M0,T(z0)=M0,t(z0)Mt,T(z).
Then by a version of Bayes’ rule and the martingale property of M0,tz0∣t∈T,
(56)e-rtV*t=EQe-rTξ∣Ft=EQe-rTIκv0ΛTe-rT∣Ft=EQe-rTIκv0M0,Tz0e-rT∣Ft=EM0,Tz0e-rT×Iκv0M0,Tz0e-rT∣Ft·EM0,Tz0∣Ft-1=EMt,Tze-rT×Iκv0M0,Tz0e-rT∣Ft=EMt,Tze-rT×Iκv0yMt,Tze-rT∣Ft.
This gives the result.For each(t,y,z)∈T×(0,∞)×(0,1), let
(57)F*(t,y,z)=F(t,y,z)e-rt.
Then if M0,t(z0)=y and Z0,t(z0)=z,
(58)F*(t,y,z)=V*(t).
This is the optimal wealth at time t, and, hence, the function F*(t,y,z) may be called an optimal wealth function.The following theorem is the main result which gives a partial differential equation for the optimal wealth functionF*(t,y,z) and an expression for the optimal portfolio strategy π*.Theorem 8.
Given thatM0,t(z0)=y and Z0,t(z0)=z, suppose that F*(t,y,z)∈C1,2,2((0,T)×(0,∞)×(0,1)). Then the optimal wealth function F*(t,y,z) satisfies the following partial differential equation:
(59)∂F*∂t+∂F*∂z-a1z+a21-z+∂F*∂y∂zρθ1z+θ21-zy1-zz+12∂2F*∂y2θ1z+θ21-zy2+12∂2F*∂z2ρ21-z2z2-rF*=0,
with terminal condition
(60)F*T,M0,Tz0,Z0,Tz0=V*(T)=ξ.
Furthermore, the optimal portfolio strategy π*(t) is given by
(61)π*(t)=∂F∂yθ1z+θ21-zy+∂F∂zρ1-zzσ-1ert,
where
(62)∂F∂y=M0,t-1(z0)EQκv0M0,Tz0e-2rT×I′κv0M0,Tz0e-rT∣Ft,∂F∂z=e-rTEQ∫tT‍θ1-θ2D0,uz0dW^Qu·Iκv0M0,Tz0e-rT+M0,Tz0κv0e-rT×I′κv0M0,Tz0e-rT∣F(t)∫tT‍θ1-θ2D0,uz0dW^Qu·D0,t-1(z0).Proof.
The results are proved using similar arguments in Elliott et al. [43], for example, Proposition 3.1. Firstly, applying Itô’s differentiation rule to F(t,y,z) gives
(63)Ft,y,z=F(0,y0,z0)+∫0t‍∂F∂udu+∫0t‍∂F∂ydM0,u(z0)+∫0t‍∂F∂zdZ0,u(z0)+12∫0t‍∂2F∂y2dM0,·(z0),M0,·(z0)(u)+∫0t‍∂2F∂y∂zdM0,·(z0),Z0,·(z0)(u)+12∫0t‍∂2F∂z2dZ0,·(z0),Z0,·(z0)(u).
Here A1,A2t∣t∈T is the predictable quadratic covariation of the processes {A1(t)∣t∈T} and {A2(t)∣t∈T}.
Rearranging then gives(64)Ft,y,z=F(0,y0,z0)+∫0t‍∂F∂u+∂F∂z-a1Z0,uz01-Z0,uz0+a21-Z0,uz0+12∂2F∂y2Θ0,u2(z0)M0,u2(z0)+12∂2F∂z2ρ21-Z0,u(z0)2Z0,u2(z0)+∂2F∂y∂zρΘ0,uz0M0,uz0·∂F∂u1-Z0,uz0Z0,u(z0)du+∫0t‍∂F∂yΘ0,u(z0)M0,u(z0)+∂F∂zρ1-Z0,uz0·∂F∂yZ0,u(z0)dW^Q(u).
From Lemma 7 and the martingale representation for the discounted optimal wealth described in Section 3,
(65)F(t,y,z)=e-rtV*(t)=v0+∫0t‍ψ(u)dW^Q(u),P-a.s.
Consequently, Ft,y,z∣t∈T is an (F,Q)-(local)-martingale, and, hence, it must be an (F,Q)-special semimartingale.
By the unique decomposition of a special semimartingale, the predictable term of finite variation in (64) must be indistinguishable from the zero process. Consequently,
(66)∂F∂t+∂F∂z-a1Z0,tz0+a21-Z0,tz0+∂2F∂y∂zρΘ0,tz0M0,tz01-Z0,tz0Z0,tz0+12∂2F∂y2Θ0,t2(z0)M0,t2(z0)+12∂2F∂z2ρ21-Z0,t(z0)2Z0,t2(z0)=0.
Then
(67)∂F∂t+∂F∂z-a1z+a21-z+∂2F∂y∂zρθ1z+θ21-zy1-zz+12∂2F∂y2θ1z+θ2(1-z)2y2+12∂2F∂z2ρ21-z2z2=0.
Therefore, (59) follows by noting that F*(t,y,z)=F(t,y,z)/e-rt and by differentiation.
Again by the unique decomposition of a special semimartingale, the integrand processes of the stochastic integrals in (64) and (65) must be indistinguishable. Consequently,
(68)ψ(t)=∂F∂yθ1z+θ21-zy+∂F∂zρ(1-z)z.
Differentiating with respect to y inside the expectation and using a version of Bayes’ rule give
(69)∂F∂y=Eκv0Mt,T2ze-2rT×I′κv0yMt,Tze-rT∣Ft=M0,t-1(z0)EQκv0M0,Tz0e-2rT×I′κv0M0,Tz0e-rT∣Ft.
Furthermore,
(70)∂F∂z=E∂Mt,Tz∂ze-rTIκv0yMt,Tze-rT∣Ft+EMt,Tze-rTI′κv0yMt,Tze-rT∂Mt,Tz∂z·κv0ye-rT∂Mt,Tz∂z∣Ft.
Differentiating with respect to z inside the expectation and using a version of Bayes’ rule and Lemma 6 give
(71)∂F∂z=EQe-rT∫tT‍θ1-θ2Dt,uzdW^Qu·Iκv0M0,Tz0e-rT∣Ft∫tT‍∫tT‍θ1-θ2Dt,uzdW^Qu+EQI′(κ(v0)yMt,T(z)e-rT)κ(v0)ye-2rTMt,T(z)∫tT‍θ1-θ2Dt,uzdW^Qu×∫tT‍θ1-θ2Dt,uzdW^Qu∣F(t).
Consequently,
(72)∂F∂z=EQe-rT∫tT‍θ1-θ2D0,uz0dW^Qu·Iκv0M0,Tz0e-rT∣Ft∫tT‍∫tT‍θ1-θ2D0,uz0dW^QuD0,t-1(z0)+EQM0,Tz0∫tT‍θ1-θ2D0,uz0dW^Qu·κ(v0)e-2rT×I′κv0M0,Tz0e-rT∣Ft∫tT‍M0,Tz0∫tT‍θ1-θ2D0,uz0dW^QuD0,t-1z0.
Expression (61) for the optimal portfolio then follows by noting that
(73)π*(t)=ψ(t)σ-1ert.Remark 9.
The partial differential equation for the optimal wealth function arising from the two-state situation is neater than that from a generalN-state case (The author would like to thank the referee for pointing out this.). The former may also have some more numerical advantages than the latter. This may represent an advantage of considering the two-state situation.Remark 10.
It is known that the martingale approach to optimal asset allocation and the risk-neutral pricing and hedging of a contingent claim are related to each other. The partial differential equation for the optimal wealth function may provide some further insights into the link between them. In particular, if the optimal terminal wealthξ is considered the terminal payoff of the claim, the optimal wealth function may be considered the value function of a self-financing replicating portfolio of the claim and hence the price function of the claim under the no-arbitrage principle. In this case, the partial differential equation for the optimal wealth function may be interpreted as the partial differential equation for the price function of the claim.Remark 11.
There are some advantages of using the stochastic flows approach comparing to the Malliavin calculus approach and the Hamilton-Jacobi-Bellman (HJB) dynamic programming approach. Compared with the Malliavin calculus approach, the stochastic flows approach does not involve the use of infinite-dimensional calculus and may be more intuitively appealing than the Malliavin calculus approach. This advantage of the stochastic flows approach in a general context has also been discussed in, for example, Elliott and Kohlmann [47, 48], amongst others. Furthermore, the stochastic flows approach gives rise to a partial differential equation for the optimal wealth function, whereas this result may not be obtained using the Malliavin calculus approach. Of course, the Malliavin calculus approach does have some advantages over the stochastic flows approach. One advantage is that the former can be used in the non-Markovian situation while the latter can only be used in the Markovian situation. In this sense, the Malliavin calculus approach is more general than the stochastic flows approach. Nevertheless, in the filtered market considered here, the wealth process and the state probability process are jointly Markovian with respect to the observed filtration, so the stochastic flows approach is applicable in the current set up. Compared with the HJB dynamic programming approach, the stochastic flows approach provides a way to justify some differentiability conditions. In particular, some differentiability conditions for the optimal wealth function in Theorem 8 may be justified by the stochastic flows of diffeomorphisms, whereas the HJB dynamic programming approach itself may not be used to justify some differentiability conditions required in the verification theorem and viscosity solutions to the HJB equation may be required. Furthermore, the verification theorem arising from the HJB dynamic programming approach requires the uniform integrability condition for the value function, which may be uneasy to verify in some situations. Using the stochastic flows approach, the optimal portfolio process depends on the optimal wealth function instead of the value function. Consequently, the verification of the uniform integrability of the value function is not required in the stochastic flows approach. (The author would like to thank the referee for stimulating the discussion.)


## 5. Conclusions

An approach based on a martingale representation and stochastic flows of diffeomorphisms was adopted to discuss an optimal asset allocation problem in a simple two-state Markovian regime-switching market. This approach may be able to accommodate quite a general class of utility functions under some differentiability conditions. As usual, standard filtering theory was first used to transform the original market into one with complete observations, where the latter is complete. When the values of the underlying state variables were given, using stochastic flows of diffeomorphisms for the filtering equation and the unique decomposition of a special semimartingale, the integrand of a martingale representation for the discounted optimal wealth process was identified which gave rise to an optimal portfolio strategy. A partial differential equation for the optimal wealth function was also provided. The results may be generalized to the case of anN-state hidden Markov chain though some complicated notation may be involved.The approach considered here may pave a way for some potentially interesting topics for future research. Firstly, one may consider incorporating portfolio constraints in the optimal asset allocation problem. Secondly, one may extend the current model to a Markovian regime-switching jump-diffusion model. Thirdly, as relating to the second topic, one may consider the application of the approach to study an optimal investment problem of an insurer. In this case, one needs to take into account insurance liabilities which may be modeled by Markov-modulated compound Poisson processes. The papers by Elliott and Siu [21] and Siu [26] may provide some clues along this direction.



---

*Source: 462524-2015-01-27.xml*