# Dynamic Nonlinear Pricing Model Based on Adaptive and Sophisticated Learning

Authors: Wenjie Bi; Yinghui Sun; Haiying Liu; Xiaohong Chen
Journal: Mathematical Problems in Engineering
 (2014)

---

## Abstract

Existing dynamic pricing models which take consumers’ learning behavior into account generally assume that consumers learn on the basis of reinforcement learning and belief-based learning. Nevertheless, abundant empirical evidence of behavior game indicates that consumers’ learning is normally described as a process of mixed learning. Particularly, for experience goods, a consumer’s purchase decision is not only based on his previous purchase behavior (adaptive learning), but also affected by that of other consumers (sophisticated learning). With the assumption that consumers are both adaptive and sophisticated learners, we study a dynamic pricing model dealing with repeated decision problems in a duopoly market. Specifically, we build a dynamic game model based on sophisticated experience-weighted attraction learning model (SEWA) and analyze the existence of the equilibrium. Finally, we show the characteristics and differences of the steady-state solutions between models considering adaptive consumers and models considering sophistical consumers by numerical results.


---

## Body

## 1. Introduction

For experience goods, consumers are only able to learn about their own preferences for a certain product after experiencing it. Studies have shown that indeed, there exists a learning process when consumers buy experience goods and they tend to be bounded rational for goods bought repeatedly [1]. Learning model describes consumers’ behavior by assuming that consumers are capable of using some simple learning rules when they make repeated decisions. Most previous research on dynamic pricing of experience goods describes consumers’ learning process with the adaptive learning model. For example, consumers’ purchase decisions are mainly based on their previous purchase behavior and usage experience. However, a large stream of empirical evidence indicates that in the market, there still exist sophisticated consumers. Different from adaptive ones, sophisticated consumers can use other consumers’ purchase information to maximize their own utility. Hence, their learning process is different with that of adaptive consumers, and the way they purchase repeatedly can affect their purchase behavior [2]. With the development of information technology and e-commerce, information is easy to get and shared worldwide, which increases the number of sophisticated consumers in the market, and it is more realistic to consider consumers’ sophisticated behavior when studying dynamic pricing problems. Therefore, we develop a sophisticated learning model based on adaptive learning and apply it to dynamic pricing problems.Most previous literature on dynamic pricing of experience goods has assumed fully rational consumers [3–5]. But consumers’ bounded rational behavior has a significant impact on market demand and corporate profits [6]. Moreover, we should pay more attention to consumers’ learning behavior when they buy experience goods. There are kinds of learning models describing consumers’ learning process. Brandts and Holt [7] propose Bayesian learning model when studying signal game. Sarin and Vahid [8] develop belief learning models. Börgers and Sarin [9] propose reinforcement learning model. Oyarzun and Sarin [10] study the reinforcement learning model in risk decision. All these learning models assume that consumers’ learning process is single. However, a fruitful avenue of empirical evidence suggests that the learning process is often a process of mixed learning. Camerer and Ho [11] develop the experience-weighted attraction learning model (EWA) which is a sort of mixed learning models, combining reinforcement learning model with brief learning model together. Furthermore, they show that EWA learning model fits remarkably better than the existing learning models in several different classes of games. Ho et al. [12] simplify the EWA model further and put forward the self-tuning EWA learning model, which has the same function to predict like the EWA learning model. But EWA model is still adaptive learning model, which cannot be used to describe the sophisticated consumers’ learning process. Camerer et al. [2] propose sophisticated experience-weighted attraction model (SEWA) based on EWA learning model describing the sophisticated consumers’ learning process.It is generally accepted that learning model is used to explain the behavior of game and individual decision making, but a lot of evidence suggests that learning model can also be used to explain the actual choice behavior [13, 14]. So far, many scholars have introduced learning model into their researches on dynamic pricing problems. Some of them use it in solving monopoly pricing problems of experience goods [15]. But generally, the market of experience goods is highly competitive. Chintagunta and Rao [16] consider the reinforcement learning model in a duopoly dynamic pricing model. Based on their study, Hopkins [17] compares and analyzes the steady state of reinforcement learning model and brief learning model in dynamic pricing. All these literatures assume that consumers’ purchase behavior is a process of adaptive learning, but Camerer et al. [2] suggest sophisticated learning of consumers are more realistic in real world. So it is necessary to take sophisticated consumers’ learning process into consideration in dynamic pricing. Amaldoss and Jain [18] found that using the sophisticated experience-weighted attraction learning model (SEWA) could explain the actual customers’ purchase behavior better in their experimental study of the dynamic pricing of luxury goods.Therefore, we study a dynamic pricing model of experience goods with both adaptive and sophisticated consumers and try to illustrate the effect of sophisticated consumers on the market structure more clearly. However, because of the particularity of experience goods, consumers cannot perceive the utility of products before purchasing; thus, there definitely exist limitations when describing the learning process of adaptive and sophisticated consumers with EWA model and SEWA model, respectively. To address these problems, we simplify the EWA model and SEWA model on the basis of belief learning proposed by Sarin and Vahid [8] and enforcement learning proposed by Börgers and Sarin [9]. When studying dynamic oligopoly problems, in addition to determining the learning model of consumers’ behavior, we also need to choose the suitable equilibrium analysis methods. There are several equilibrium concepts—open-loop equilibrium, closed-loop equilibrium, and Markov perfect equilibrium. We mainly use open-loop equilibrium for it can conduct qualitative analysis on the steady-state solutions and stability and what is more, the analysis is simple [19]. The main contribution of this paper is as follows: (
1
) we propose a dynamic pricing model based on adaptive learning and sophisticated learning; (
2
) we also perform numerical comparison of dynamic pricing equilibrium solutions between sophisticated and adaptive learning. It can be concluded that, for nonlinear dynamic pricing problems, both models have groups of equilibrium solutions. Compared with the dynamic pricing model of adaptive consumers, however, when that of sophisticated consumers reaches a symmetric Nash equilibrium, differences between the two companies’ market share will decrease.The rest of this paper is organized as follows. The next section introduces the duopoly dynamic pricing model based on the adaptive learning of EWA and analyzes the characteristics of steady states. In Section3, we study the duopoly dynamic pricing model based on the sophisticated learning model and analyze the qualities of steady-state solutions through numerical solution. In Section 4, we summarize and conclude.


## 2. Dynamic Pricing Model of Duopoly Based on Adaptive Learning

We consider the infinite duopoly dynamic pricing model of adaptive consumers. In the market of repeated purchasing, assume that there are two firms—firm 1 and firm 2—producing two brands of experience goods (such as daily necessities, etc.). There are lots of consumers in the market and each one chooses only one brand to purchase at every period. When deciding to buy a brand at every period, adaptive consumers update their propensity to a brand according to their previous experience. We use EWA to describe consumers’ learning process. And adaptive learning model based on EWA that is composed of three elements. The first one is consumers’ propensity for the two goods which we denote byA
a
=
(
A
1
a
,
A
2
a
), and it is determined by goods’ prices and consumers’ evaluation on quality or goodwill of goods, A
i
a
=
θ
i
a
-
p
i. The prices of the two goods are described as p
=
(
p
1
,
p
2
)
(
p
i
∈
[
0
,
∞
), (i
=
1,2). Consumers’ evaluation on quality or goodwill of goods is denoted by θ
a
=
(
θ
1
a
,
θ
2
a
), (i
=
1,2). We assume consumers’ propensity for goods is A
i
a
∈
[
0
,
∞
); thus, θ
i
a
≥
p
i and θ
i
a
∈
[
0
,
∞
). The second one is the choice rule, describing the probability to choose goods on the basis of goods’ propensity. The last one is the updating rule, describing the process which consumers update their propensity at each period. Table 1 lists all of the symbols used in this paper.Table 1
List of symbols (i
=
1,2).
A
i
a
,
A
i
s
A
i
a
,
A
i
s denote, respectively, the propensity of adaptive and sophisticated consumers to good A
i
a
,
A
i
s
∈
[
0
,
∞
)
θ
i
a
,
θ
i
s
θ
i
a
,
θ
i
s are the adaptive and sophisticated consumers’ estimate for the quality or goodwill of good i, respectively. θ
i
a
,
θ
i
s
∈
[
0
,
∞
) and θ
i
a
,
θ
i
s
≥
p
i
p
i
The price of goodi. p
i
∈
[
0
,
∞
)
η
a
,
η
s
η
a
,
η
s are the adaptive and sophisticated consumers’ relative quality or goodwill of two goods, respectively. η
a
=
θ
1
a
-
θ
2
a
;
η
s
=
θ
1
s
-
θ
2
s
ρ
ρ
=
p
1
-
p
2 is the relative price of two goods.
q
i
a
,
q
i
s
q
i
a
,
q
i
s are the probability that the adaptive consumers, sophisticated consumers choose good i, respectively. 0
≤
q
i
a
,
q
i
s
≤
1
β
β measures the sensitivity of consumers for goods. β
∈
[
0
,
∞
].
π
~
i
(
t
)
π
~
i
(
t
) is the utility which is got by consuming good i at time t,
δ
1
δ
1 is the “recency” parameter of preference for purchased goods. 0
<
δ
1
≤
1
δ
2
δ
2 is the “recency” parameter of preference for goods which are not purchased.
ω
ω
=
δ
2
/
δ
1 is the ratio of “recency” parameters described by δ
1 and δ
2. 0
≤
ω
≤
1
λ
λ respects the influence coefficient from other consumers to sophisticated consumers. λ
≥
0
σ
σ
=
λ
/
δ
1 is the ratio of influence coefficient λ and “recency” parameter δ
1. σ
≥
0


### 2.1. Choice Probabilities

Consumers’ preference for goodi will affect the probability of choosing it in some way. Furthermore, the more degree a consumer prefers a certain good, the more likely he chooses it. That means q
i
a should increase along with A
i
a and decrease along with A
j
a monotonically (where j
≠
i). There are several probability functions meeting the above requirements, such as Logit, power, and probit. Previous studies illustrate that the Logit forms fit better than the others [20]. So we use the Logit function, which is commonly used in the studies about making brand choices with risk and uncertainty [21, 22]. Based on the Logit rules, the probability of a consumer choosing good 1 from the first firm is
(1)
q
1
a
=
e
β
A
1
a
e
β
A
1
a
+
e
β
A
2
a
=
e
β
(
θ
1
a
-
p
1
)
e
β
(
θ
1
a
-
p
1
)
+
e
β
(
θ
2
a
-
p
2
)
=
e
β
(
η
a
-
ρ
)
e
β
(
η
a
-
ρ
)
+
1
.
The probability that a consumer chooses good 2 is q
2
a
=
1
-
q
1
a. β is the optimal degree of consumers, and the probability a consumer chooses the optimal product increases with β. If β
=
0, the consumer will choose every good with equal probability, and if β
=
∞, then he will choose the optimal product with the probability of 1. η
a
=
θ
1
a
-
θ
2
a is the relative quality or goodwill of two goods for adaptive consumers; ρ
=
p
1
-
p
2 is the relative price of two goods. According to (1), the consumers’ choosing probability q
i
a (i
=
1,2) is nonlinear and the degree of its nonlinearity depends on the optimization parameter β. For example, if β is very small, q
1
a
(
η
a
,
ρ
)
≈
1
/
2
+
β
(
η
a
-
ρ
)
/
4 approximates a linear function.We consider the customers in the market as a whole, the number of the consumers isN
=
1 and the total demand of the market is N
·
q
i
a
=
q
i
a. Thus, we can consider the probability that the consumer chooses good i as the total demand of the market.


### 2.2. Updating Rules

Prices for experience goods are usually clearly marked on the shelves. Thus, the learning the consumer has to undertake is neither their prices nor their distribution but about the quality or goodwill of experience goods. And consumers are only able to receive a payoff for product after experiencing it. For this information case asymmetry, Erev and Roth [13] propose a reinforcement learning model, the updating rule is
(2)
θ
i
a
(
t
+
1
)
=
(
1
-
δ
)
θ
i
a
(
t
)
+
δ
π
~
i
(
t
)
θ
j
a
(
t
+
1
)
=
(
1
-
δ
)
θ
j
a
(
t
)
,
∀
j
≠
i
,
where θ
i
a
(
t
), θ
j
a
(
t
) is the consumers’ estimate for the quality or goodwill of good i and j at t, respectively. π
~
i
(
t
) is the utility which is acquired by consuming good i at t. A consumer’s choice behavior is random due to a given Logit choice rule. In this context we assume that the consumer’s experience is also random. So π
~
i
(
t
) is a random variable. We assume π
i is the average value of π
~
i
(
t
). δ is the “recency” parameter, 0
<
δ
≤
1. δ
=
1 means only the last period is remembered. If δ approaches to zero, it indicates that previous experience has great effect on present belief. In reinforcement learning model, the good i is purchased at the previous period and the good j is not purchased at the previous period.Sarin and Vahid [8] propose a “belief-based” learning model and the updating rule is
(3)
θ
i
a
(
t
+
1
)
=
(
1
-
δ
)
θ
i
a
(
t
)
+
δ
π
~
i
(
t
)
θ
j
a
(
t
+
1
)
=
θ
j
a
(
t
)
,
∀
j
≠
i
,
where θ
i
a
(
t
), θ
j
a
(
t
), π
~
i
(
t
), i, j and δ in (3) are the same as in (2).However, considerable empirical evidence suggests that the learning process is often a process of mixed learning. Therefore, in order to accurately describe the consumer’s learning process, we combine rules (2) and (3) by a similar way with Camerer and Ho [11] and obtain an adaptive learning model based on EWA. The updating rule is
(4)
θ
i
a
(
t
+
1
)
=
(
1
-
δ
1
)
θ
i
a
(
t
)
+
δ
1
π
~
i
(
t
)
θ
j
a
(
t
+
1
)
=
(
1
-
δ
2
)
θ
j
a
(
t
)
,
∀
j
≠
i
,
where δ
1 is the “recency” parameter of preference for purchased goods and δ
2 is the “recency” parameter of preference for goods not purchased, 0
<
δ
1, δ
2
≤
1. i and j are the same as in (2).Assumption 1.
The “recency” parameterδ
1, δ
2 can be seen as coefficient memory and consumers are more impressed for the purchased good than the nonpurchased good. Therefore, we assume that δ
1
≥
δ
2 and 0
≤
ω
=
δ
2
/
δ
1
≤
1. ω
=
0 means that the EWA model turns to belief learning model and ω
=
1 means that the EWA model turns to reinforcement learning model.The following Proposition2 shows the continuous time updating rule of adaptive consumers.Proposition 2.
The continuous time updating rule of adaptive consumers is(5)
θ
˙
1
a
=
q
1
a
π
1
-
q
1
a
θ
1
a
+
ω
(
q
1
a
θ
1
a
-
θ
1
a
)
θ
˙
2
a
=
q
2
a
π
2
-
q
2
a
θ
2
a
+
ω
(
q
2
a
θ
2
a
-
θ
2
a
)
.Proof.
See the Appendix.


### 2.3. Equilibrium Analysis of Dynamic Pricing Model

We suppose the two firms producing a product at a constant marginal cost in timet, and marginal cost for both brands is normalized to zero. Then the optimal function of firm’s long-term profit is
(6)
∫
t
=
0
∞
e
-
r
t
p
i
q
i
(
θ
,
p
)
d
t
(
i
=
1,2
)
subject to
(7)
θ
˙
1
a
=
q
1
a
π
1
-
q
1
a
θ
1
a
+
ω
(
q
1
a
θ
1
a
-
θ
1
a
)
θ
˙
2
a
=
q
2
a
π
2
-
q
2
a
θ
2
a
+
ω
(
q
2
a
θ
2
a
-
θ
2
a
)
.For myopic firm, its short-term profit is described asp
i
(
t
)
q
i
a
(
t
), which is the value function. In order to analyse the existence of Nash equilibrium of our model, we further make the following general assumption on the value function.Assumption 3.
The following assumption hold for alli, t.(1)
The strategy setsp
i are nonempty convex.
(2)
The firmi’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) are uniformly bounded. That is, sup
⁡
p
i
p
i
(
t
)
q
i
a
(
t
)
<
∞.Lemma 4.
The firmi’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) are quasiconcave in p
i (i
=
1,2).Proof.
Taking the first derivative ofp
i
(
t
)
q
i
a
(
t
) with respect to p
i yields
(8)
∂
p
i
q
i
a
∂
p
i
=
q
i
a
[
1
-
β
(
1
-
q
i
a
)
p
i
]
.
Leth
i
=
1
-
β
(
1
-
q
i
a
)
p
i and consider the following two cases.(1)
The functionh
i
≠
0 for all p
i
≥
0. Because h
i is continuous and li
m
p
i
→
∞
h
i
=
-
∞, it follows that h
i
<
0 for p
i
≥
0. Hence, p
i
(
t
)
q
i
a
(
t
) strictly decreases in p
i for p
i
≥
0 and therefore is strongly quasiconcave.
(2)
There existsp
~
i such that h
i
(
p
~
i
)
=
0. The second derivative of p
i
(
t
)
q
i
a
(
t
) with respect to p
i evaluated at p
~
i is equal to
(9)
∂
2
p
i
q
i
a
∂
p
i
2
=
∂
q
i
a
∂
p
i
h
i
|
p
i
=
p
~
i
+
∂
h
i
∂
p
i
q
i
a
|
p
i
=
p
~
i
=
0
+
∂
[
1
-
β
(
1
-
q
i
a
)
p
i
]
∂
p
i
q
i
a
|
p
i
=
p
~
i
=
-
β
q
i
a
(
1
-
q
i
a
)
-
β
2
(
q
i
a
)
2
(
1
-
q
i
a
)
p
i
|
p
i
=
p
~
i
<
0
,where the third equality follows from h
i
(
p
~
i
)
=
0. The preceding shows that p
~
i is a local maximum of p
i
(
t
)
q
i
a
(
t
) and that there does not exist an interior minimum for p
i
∈
[
0
,
∞
). It then follows that p
~
i is unique because otherwise there must exist an interior minimum for p
i
(
t
)
q
i
a
(
t
). Consequently, the function p
i
(
t
)
q
i
a
(
t
) increases for p
i
∈
[
0
,
p
~
i
) and decreases for p
i
∈
(
p
~
i
,
∞
), and therefore is strongly quasiconcave.Lemma 5.
There exists at least one Nash equilibrium in dynamic pricing model of duopoly based on adaptive learning (see (6)).Proof.
From Theorem 2.1 in Vives [23], we see that if the strategy sets are nonempty convex and compact, and the firm i’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) is continuous in the prices of all firms and quasiconcave in its own price, the Nash equilibrium will exist. In our model, although each firm can choose a price from [
0
,
∞
), which is not compact, the firm i’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) are uniformly bounded, allowing us to construct an equivalent model by restricting firm i to choose a price from a nonempty convex and compact set. In addition, the firm i’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) a continuous and quasiconcave in p
i (i
=
1,2). So, there exists Nash equilibrium in dynamic pricing model of duopoly based on adaptive learning.
By analyzing (6) and (5), we obtain the following steady states of Nash equilibrium.Proposition 6.
The steady states of open-loop Nash equilibrium satisfying the following (10) and (11):
(10)
ρ
+
ω
π
1
(
2
q
1
a
-
1
)
(
q
1
a
-
ω
q
1
a
+
ω
)
(
q
1
a
-
ω
q
1
a
+
ω
+
r
)
+
ω
π
2
(
2
q
1
a
-
1
)
(
1
-
q
1
a
+
ω
q
1
a
+
r
)
(
1
-
q
1
a
+
ω
q
1
a
)
=
1
β
q
2
a
-
1
β
q
1
a
(11)
η
a
=
q
1
a
π
1
(
q
1
a
-
ω
q
1
a
+
ω
)
-
q
2
a
π
2
(
q
2
a
-
ω
q
2
a
+
ω
)
.Proof.
See the Appendix.According to (10) and (11), consumer’s choosing probability q
i
a is nonlinear, so the steady-state solution is also nonlinear, and the steady-state may have multiple solutions. Additional, it can be seen from (10) and (11) that if ω is close to zero, there is only one steady-state solution.The following proposition shows the relationship between the myopic optimal price and optimal steady-state price. We setp
^
i
(
η
a
) as the firms’ myopic optimal price, and the solution is p
^
i
(
η
a
)
=
1
/
β
(
1
-
q
i
a
). (It has been established by Caplin and Nalebuff [24] that Nash equilibrium in oligopoly with Logit demand functions exists and is unique.)Proposition 7.
Ifp
i
*
(
η
a
) is the solution of (10) and (11), at any path of the optimal price, each firm’s optimal price is p
i
*
(
η
a
)
≤
p
^
i
(
η
a
) (the equality holds δ
2
=
0. i
=
1,2).Proof.
See the Appendix.


### 2.4. Numerical Results

The steady-state prices satisfy (10) and (11). Because q
i
a is nonlinear equation of η
a and ρ, so we turn (10) and (11) into the nonlinear equations of η
a and ρ and get the steady-state solution by solving equations. In fact, (10) and (11) have several different sets of steady-state solution. For instance, we assume that π
1
=
π
2
=
π. That is, the two goods are identical. If π
=
2, r
=
1, β
=
2, and ω
=
0.5, there are three groups of steady-state solutions for (
η
a
,
p
1
,
p
2
), that is (
-
0.6866,0.2398,0.5338
), (
0,0
,
0
), and (
0.6866,0.5338,0.2398
). As is shown in Figure 1, the curve of (10) and the curve of (11) have three intersections. Respectively, the corresponding probabilities are q
1
a
=
0.31, q
1
a
=
0.5, and q
1
a
=
0.69. If π
=
2, r
=
1, β
=
2, and ω
=
1 (ω
=
1 means the adaptive learning model based on EWA turning to the reinforcement learning model); there are also three groups of steady-state solutions for (
η
a
,
p
1
,
p
2
), that is (
-
1.103,0.196,0.679
), (
0,0
,
0
), and (
1.103,0.679,0.196
). As is shown in Figure 2, the curve of (10) and the curve of (11) have three intersections. Respectively, the corresponding probability q
1
a is q
1
a
=
0.224, q
1
a
=
0.5, and q
1
a
=
0.776. If π
=
2, r
=
1, β
=
2, and ω
=
0 (ω
=
0 means the adaptive learning model based on EWA turning to the belief learning model); we can see directly that (10) and (11) have only one steady-state solution (
η
a
,
p
1
,
p
2
)
=
(
0,0
,
0
), and the corresponding probability q
1
a is 0.5.Figure 1
Steady states whenω
=
0.5.Figure 2
Steady states whenω
=
1.Based on Figures1 and 2, if 0
<
ω
≤
1 and β is big enough, there will always be three groups of the steady-state solution, and the greater ω is, the more divergent three sets of steady-state solutions are. If η
a
(
0
) is a small positive number, as long as firm 1 charges a price lower than myopic optimal price, the third equilibrium solution will emerge, q
1
a
=
0.69 and q
1
a
=
0.776. In other words, by selecting a lower initial price, the firm has the capability of making some naive consumers fascinated and gaining a greater market share. What is more, comparing Figure 1 with Figure 2, it can be seen that the three solutions in Figure 2 are more divergent, which indicates that the two firms have greater differences in their market share under the balanced equilibrium on both sides. In order to illustrate the relationship between the number of steady-state solutions and ω, we get Figure 3 with π
=
2, r
=
1, and β
=
2. Therefore, we can draw the conclusion that compared to the adaptive learning model based on EWA, reinforcement learning model gives consumers more possibilities to choose their own familiar goods. As a result, consumers gradually are trapped in those products with inferior quality.Figure 3
The relationship betweenω and η
a.What happens if one firm holds a quality advantage? We assume thatπ
1
≠
π
2 and π
2
=
2, r
=
1, β
=
2, and ω
=
0.5; then we get the relationship between π
1 and η
a which isillustrated in Figure 4. From Figure 4 we can see that there exists a steady state when π
1
<
1.946 and π
1
>
2.1005, and there are three steady state when 1.946
≤
π
1
≤
2.1005. This illustrates that it remains true that dominance by a low quality firm is a possibility if the initial value of goodwill η
a
(
0
) is sufficiently close to the appropriate steady state.Figure 4
The relationship betweenπ
1 and η
a.


## 2.1. Choice Probabilities

Consumers’ preference for goodi will affect the probability of choosing it in some way. Furthermore, the more degree a consumer prefers a certain good, the more likely he chooses it. That means q
i
a should increase along with A
i
a and decrease along with A
j
a monotonically (where j
≠
i). There are several probability functions meeting the above requirements, such as Logit, power, and probit. Previous studies illustrate that the Logit forms fit better than the others [20]. So we use the Logit function, which is commonly used in the studies about making brand choices with risk and uncertainty [21, 22]. Based on the Logit rules, the probability of a consumer choosing good 1 from the first firm is
(1)
q
1
a
=
e
β
A
1
a
e
β
A
1
a
+
e
β
A
2
a
=
e
β
(
θ
1
a
-
p
1
)
e
β
(
θ
1
a
-
p
1
)
+
e
β
(
θ
2
a
-
p
2
)
=
e
β
(
η
a
-
ρ
)
e
β
(
η
a
-
ρ
)
+
1
.
The probability that a consumer chooses good 2 is q
2
a
=
1
-
q
1
a. β is the optimal degree of consumers, and the probability a consumer chooses the optimal product increases with β. If β
=
0, the consumer will choose every good with equal probability, and if β
=
∞, then he will choose the optimal product with the probability of 1. η
a
=
θ
1
a
-
θ
2
a is the relative quality or goodwill of two goods for adaptive consumers; ρ
=
p
1
-
p
2 is the relative price of two goods. According to (1), the consumers’ choosing probability q
i
a (i
=
1,2) is nonlinear and the degree of its nonlinearity depends on the optimization parameter β. For example, if β is very small, q
1
a
(
η
a
,
ρ
)
≈
1
/
2
+
β
(
η
a
-
ρ
)
/
4 approximates a linear function.We consider the customers in the market as a whole, the number of the consumers isN
=
1 and the total demand of the market is N
·
q
i
a
=
q
i
a. Thus, we can consider the probability that the consumer chooses good i as the total demand of the market.


## 2.2. Updating Rules

Prices for experience goods are usually clearly marked on the shelves. Thus, the learning the consumer has to undertake is neither their prices nor their distribution but about the quality or goodwill of experience goods. And consumers are only able to receive a payoff for product after experiencing it. For this information case asymmetry, Erev and Roth [13] propose a reinforcement learning model, the updating rule is
(2)
θ
i
a
(
t
+
1
)
=
(
1
-
δ
)
θ
i
a
(
t
)
+
δ
π
~
i
(
t
)
θ
j
a
(
t
+
1
)
=
(
1
-
δ
)
θ
j
a
(
t
)
,
∀
j
≠
i
,
where θ
i
a
(
t
), θ
j
a
(
t
) is the consumers’ estimate for the quality or goodwill of good i and j at t, respectively. π
~
i
(
t
) is the utility which is acquired by consuming good i at t. A consumer’s choice behavior is random due to a given Logit choice rule. In this context we assume that the consumer’s experience is also random. So π
~
i
(
t
) is a random variable. We assume π
i is the average value of π
~
i
(
t
). δ is the “recency” parameter, 0
<
δ
≤
1. δ
=
1 means only the last period is remembered. If δ approaches to zero, it indicates that previous experience has great effect on present belief. In reinforcement learning model, the good i is purchased at the previous period and the good j is not purchased at the previous period.Sarin and Vahid [8] propose a “belief-based” learning model and the updating rule is
(3)
θ
i
a
(
t
+
1
)
=
(
1
-
δ
)
θ
i
a
(
t
)
+
δ
π
~
i
(
t
)
θ
j
a
(
t
+
1
)
=
θ
j
a
(
t
)
,
∀
j
≠
i
,
where θ
i
a
(
t
), θ
j
a
(
t
), π
~
i
(
t
), i, j and δ in (3) are the same as in (2).However, considerable empirical evidence suggests that the learning process is often a process of mixed learning. Therefore, in order to accurately describe the consumer’s learning process, we combine rules (2) and (3) by a similar way with Camerer and Ho [11] and obtain an adaptive learning model based on EWA. The updating rule is
(4)
θ
i
a
(
t
+
1
)
=
(
1
-
δ
1
)
θ
i
a
(
t
)
+
δ
1
π
~
i
(
t
)
θ
j
a
(
t
+
1
)
=
(
1
-
δ
2
)
θ
j
a
(
t
)
,
∀
j
≠
i
,
where δ
1 is the “recency” parameter of preference for purchased goods and δ
2 is the “recency” parameter of preference for goods not purchased, 0
<
δ
1, δ
2
≤
1. i and j are the same as in (2).Assumption 1.
The “recency” parameterδ
1, δ
2 can be seen as coefficient memory and consumers are more impressed for the purchased good than the nonpurchased good. Therefore, we assume that δ
1
≥
δ
2 and 0
≤
ω
=
δ
2
/
δ
1
≤
1. ω
=
0 means that the EWA model turns to belief learning model and ω
=
1 means that the EWA model turns to reinforcement learning model.The following Proposition2 shows the continuous time updating rule of adaptive consumers.Proposition 2.
The continuous time updating rule of adaptive consumers is(5)
θ
˙
1
a
=
q
1
a
π
1
-
q
1
a
θ
1
a
+
ω
(
q
1
a
θ
1
a
-
θ
1
a
)
θ
˙
2
a
=
q
2
a
π
2
-
q
2
a
θ
2
a
+
ω
(
q
2
a
θ
2
a
-
θ
2
a
)
.Proof.
See the Appendix.


## 2.3. Equilibrium Analysis of Dynamic Pricing Model

We suppose the two firms producing a product at a constant marginal cost in timet, and marginal cost for both brands is normalized to zero. Then the optimal function of firm’s long-term profit is
(6)
∫
t
=
0
∞
e
-
r
t
p
i
q
i
(
θ
,
p
)
d
t
(
i
=
1,2
)
subject to
(7)
θ
˙
1
a
=
q
1
a
π
1
-
q
1
a
θ
1
a
+
ω
(
q
1
a
θ
1
a
-
θ
1
a
)
θ
˙
2
a
=
q
2
a
π
2
-
q
2
a
θ
2
a
+
ω
(
q
2
a
θ
2
a
-
θ
2
a
)
.For myopic firm, its short-term profit is described asp
i
(
t
)
q
i
a
(
t
), which is the value function. In order to analyse the existence of Nash equilibrium of our model, we further make the following general assumption on the value function.Assumption 3.
The following assumption hold for alli, t.(1)
The strategy setsp
i are nonempty convex.
(2)
The firmi’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) are uniformly bounded. That is, sup
⁡
p
i
p
i
(
t
)
q
i
a
(
t
)
<
∞.Lemma 4.
The firmi’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) are quasiconcave in p
i (i
=
1,2).Proof.
Taking the first derivative ofp
i
(
t
)
q
i
a
(
t
) with respect to p
i yields
(8)
∂
p
i
q
i
a
∂
p
i
=
q
i
a
[
1
-
β
(
1
-
q
i
a
)
p
i
]
.
Leth
i
=
1
-
β
(
1
-
q
i
a
)
p
i and consider the following two cases.(1)
The functionh
i
≠
0 for all p
i
≥
0. Because h
i is continuous and li
m
p
i
→
∞
h
i
=
-
∞, it follows that h
i
<
0 for p
i
≥
0. Hence, p
i
(
t
)
q
i
a
(
t
) strictly decreases in p
i for p
i
≥
0 and therefore is strongly quasiconcave.
(2)
There existsp
~
i such that h
i
(
p
~
i
)
=
0. The second derivative of p
i
(
t
)
q
i
a
(
t
) with respect to p
i evaluated at p
~
i is equal to
(9)
∂
2
p
i
q
i
a
∂
p
i
2
=
∂
q
i
a
∂
p
i
h
i
|
p
i
=
p
~
i
+
∂
h
i
∂
p
i
q
i
a
|
p
i
=
p
~
i
=
0
+
∂
[
1
-
β
(
1
-
q
i
a
)
p
i
]
∂
p
i
q
i
a
|
p
i
=
p
~
i
=
-
β
q
i
a
(
1
-
q
i
a
)
-
β
2
(
q
i
a
)
2
(
1
-
q
i
a
)
p
i
|
p
i
=
p
~
i
<
0
,where the third equality follows from h
i
(
p
~
i
)
=
0. The preceding shows that p
~
i is a local maximum of p
i
(
t
)
q
i
a
(
t
) and that there does not exist an interior minimum for p
i
∈
[
0
,
∞
). It then follows that p
~
i is unique because otherwise there must exist an interior minimum for p
i
(
t
)
q
i
a
(
t
). Consequently, the function p
i
(
t
)
q
i
a
(
t
) increases for p
i
∈
[
0
,
p
~
i
) and decreases for p
i
∈
(
p
~
i
,
∞
), and therefore is strongly quasiconcave.Lemma 5.
There exists at least one Nash equilibrium in dynamic pricing model of duopoly based on adaptive learning (see (6)).Proof.
From Theorem 2.1 in Vives [23], we see that if the strategy sets are nonempty convex and compact, and the firm i’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) is continuous in the prices of all firms and quasiconcave in its own price, the Nash equilibrium will exist. In our model, although each firm can choose a price from [
0
,
∞
), which is not compact, the firm i’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) are uniformly bounded, allowing us to construct an equivalent model by restricting firm i to choose a price from a nonempty convex and compact set. In addition, the firm i’s instantaneous profits p
i
(
t
)
q
i
a
(
t
) a continuous and quasiconcave in p
i (i
=
1,2). So, there exists Nash equilibrium in dynamic pricing model of duopoly based on adaptive learning.
By analyzing (6) and (5), we obtain the following steady states of Nash equilibrium.Proposition 6.
The steady states of open-loop Nash equilibrium satisfying the following (10) and (11):
(10)
ρ
+
ω
π
1
(
2
q
1
a
-
1
)
(
q
1
a
-
ω
q
1
a
+
ω
)
(
q
1
a
-
ω
q
1
a
+
ω
+
r
)
+
ω
π
2
(
2
q
1
a
-
1
)
(
1
-
q
1
a
+
ω
q
1
a
+
r
)
(
1
-
q
1
a
+
ω
q
1
a
)
=
1
β
q
2
a
-
1
β
q
1
a
(11)
η
a
=
q
1
a
π
1
(
q
1
a
-
ω
q
1
a
+
ω
)
-
q
2
a
π
2
(
q
2
a
-
ω
q
2
a
+
ω
)
.Proof.
See the Appendix.According to (10) and (11), consumer’s choosing probability q
i
a is nonlinear, so the steady-state solution is also nonlinear, and the steady-state may have multiple solutions. Additional, it can be seen from (10) and (11) that if ω is close to zero, there is only one steady-state solution.The following proposition shows the relationship between the myopic optimal price and optimal steady-state price. We setp
^
i
(
η
a
) as the firms’ myopic optimal price, and the solution is p
^
i
(
η
a
)
=
1
/
β
(
1
-
q
i
a
). (It has been established by Caplin and Nalebuff [24] that Nash equilibrium in oligopoly with Logit demand functions exists and is unique.)Proposition 7.
Ifp
i
*
(
η
a
) is the solution of (10) and (11), at any path of the optimal price, each firm’s optimal price is p
i
*
(
η
a
)
≤
p
^
i
(
η
a
) (the equality holds δ
2
=
0. i
=
1,2).Proof.
See the Appendix.


## 2.4. Numerical Results

The steady-state prices satisfy (10) and (11). Because q
i
a is nonlinear equation of η
a and ρ, so we turn (10) and (11) into the nonlinear equations of η
a and ρ and get the steady-state solution by solving equations. In fact, (10) and (11) have several different sets of steady-state solution. For instance, we assume that π
1
=
π
2
=
π. That is, the two goods are identical. If π
=
2, r
=
1, β
=
2, and ω
=
0.5, there are three groups of steady-state solutions for (
η
a
,
p
1
,
p
2
), that is (
-
0.6866,0.2398,0.5338
), (
0,0
,
0
), and (
0.6866,0.5338,0.2398
). As is shown in Figure 1, the curve of (10) and the curve of (11) have three intersections. Respectively, the corresponding probabilities are q
1
a
=
0.31, q
1
a
=
0.5, and q
1
a
=
0.69. If π
=
2, r
=
1, β
=
2, and ω
=
1 (ω
=
1 means the adaptive learning model based on EWA turning to the reinforcement learning model); there are also three groups of steady-state solutions for (
η
a
,
p
1
,
p
2
), that is (
-
1.103,0.196,0.679
), (
0,0
,
0
), and (
1.103,0.679,0.196
). As is shown in Figure 2, the curve of (10) and the curve of (11) have three intersections. Respectively, the corresponding probability q
1
a is q
1
a
=
0.224, q
1
a
=
0.5, and q
1
a
=
0.776. If π
=
2, r
=
1, β
=
2, and ω
=
0 (ω
=
0 means the adaptive learning model based on EWA turning to the belief learning model); we can see directly that (10) and (11) have only one steady-state solution (
η
a
,
p
1
,
p
2
)
=
(
0,0
,
0
), and the corresponding probability q
1
a is 0.5.Figure 1
Steady states whenω
=
0.5.Figure 2
Steady states whenω
=
1.Based on Figures1 and 2, if 0
<
ω
≤
1 and β is big enough, there will always be three groups of the steady-state solution, and the greater ω is, the more divergent three sets of steady-state solutions are. If η
a
(
0
) is a small positive number, as long as firm 1 charges a price lower than myopic optimal price, the third equilibrium solution will emerge, q
1
a
=
0.69 and q
1
a
=
0.776. In other words, by selecting a lower initial price, the firm has the capability of making some naive consumers fascinated and gaining a greater market share. What is more, comparing Figure 1 with Figure 2, it can be seen that the three solutions in Figure 2 are more divergent, which indicates that the two firms have greater differences in their market share under the balanced equilibrium on both sides. In order to illustrate the relationship between the number of steady-state solutions and ω, we get Figure 3 with π
=
2, r
=
1, and β
=
2. Therefore, we can draw the conclusion that compared to the adaptive learning model based on EWA, reinforcement learning model gives consumers more possibilities to choose their own familiar goods. As a result, consumers gradually are trapped in those products with inferior quality.Figure 3
The relationship betweenω and η
a.What happens if one firm holds a quality advantage? We assume thatπ
1
≠
π
2 and π
2
=
2, r
=
1, β
=
2, and ω
=
0.5; then we get the relationship between π
1 and η
a which isillustrated in Figure 4. From Figure 4 we can see that there exists a steady state when π
1
<
1.946 and π
1
>
2.1005, and there are three steady state when 1.946
≤
π
1
≤
2.1005. This illustrates that it remains true that dominance by a low quality firm is a possibility if the initial value of goodwill η
a
(
0
) is sufficiently close to the appropriate steady state.Figure 4
The relationship betweenπ
1 and η
a.


## 3. Dynamic Pricing Model of Duopoly Based on Sophisticated Learning

With the development of information technology and e-commerce, access to information is getting easier. Some consumers may update their thoughts about the quality or goodwill of experience goods not only by their own experience but also taking advantage of other consumers’ purchase information. We call this part of consumers as sophisticated consumers. The way they purchase repeatedly can affect their purchase behavior, and the consumer’s behavior can affect market structure. Thus, taking sophisticated consumers into account when study the dynamic pricing problems is more in accordance with reality.Like the previous assumptions, there are two firms 1 and 2 producing experience goods with two brands. At each point in time the consumer seeks to buy one unit of the good, either from firm 1 or firm 2. Here we assume that there are two types of consumers on the market, one is adaptive consumers, their proportion is1
-
α, and the other one is sophisticated consumers, their proportion is α.Same as adaptive learning model based on EWA, sophisticated learning model is composed of three elements. The first one is consumers’ propensity for the two goods which we denoted asA
s
=
(
A
1
s
,
A
2
s
). The prices of the two goods are described as p
=
(
p
1
,
p
2
), and consumers’ evaluation on quality or goodwill of goods is denoted by θ
s
=
(
θ
1
s
,
θ
2
s
). A
i
s
=
θ
i
s
-
p
i (i
=
1,2). The second one is the choice probabilities. The last one is the updating rule. The significant difference between sophisticated learning and adaptive learning model is the updating rule. We will describe this difference in detail in Section 3.2.


### 3.1. Choice Probabilities

Same as the adaptive consumers, the sophisticated consumers’ choice probability can be given as(12)
q
1
s
=
e
β
A
1
s
e
β
A
1
s
+
e
β
A
2
s
=
e
β
(
θ
1
s
-
p
1
)
e
β
(
θ
1
s
-
p
1
)
+
e
β
(
θ
2
s
-
p
2
)
=
e
β
(
η
s
-
ρ
)
e
β
(
η
s
-
ρ
)
+
1
and q
2
s
=
1
-
q
1
s. Where θ
s
=
(
θ
1
s
,
θ
2
s
) is the sophisticated consumers’ estimate for the quality or goodwill of good and η
s
=
θ
1
s
-
θ
2
s is the relative quality or goodwill of two goods for sophisticated. According to (12), the consumers’ choosing probability q
i
s (i
=
1,2
) is nonlinear. The nonlinearity arises from the nonlinearity of the demand function q
1
s
(
η
s
,
ρ
) and the degree of its nonlinearity depends on the optimization parameter β. For example, if β is very small, q
1
s
(
η
s
,
ρ
)
≈
1
/
2
+
β
(
η
s
-
ρ
)
/
4 approximates a linear function.We assume the customers in the market as a whole (N
=
1) as in Section 2.1. So the total demand of the market is q
1
=
α
q
1
s
+
(
1
-
α
)
q
1
a.


### 3.2. Updating Rules

Because sophisticated consumers are easily influenced by other consumers when they make purchase decisions. We assume that, for a consumer, the more the goods he buys, the better the quality of the goods is. In other words, the less he purchases, the poorer the quality is. Therefore, we assume that the credit evaluation for sophisticated consumers after purchasing good 1 is(13)
θ
1
s
(
s
1
s
,
s
i
k
)
=
(
1
-
δ
1
)
θ
1
s
(
t
)
+
δ
1
π
~
1
(
t
)
+
λ
m
-
λ
n
,
where s
1
s represents sophisticated consumers’ strategy for purchasing good 1. s
i
k means other consumers’ purchase strategy. m is the number of customers buying good 1, while n is those who buy good 2. So the overall number of customers in the market is N
=
m
+
n. Considering customers on the market as a whole, we get N
=
1.According to the SEWA model proposed by Camerer et al. [2], we have
(14)
θ
1
s
(
t
+
1
)
=
∑
k
=
1
m
-
i
[
α
q
1
s
(
t
)
+
(
1
-
α
)
·
q
1
a
(
t
)
]
θ
1
s
(
s
1
s
,
s
i
k
)
=
∑
m
=
0
N
C
N
m
[
q
1
(
t
)
]
m
[
1
-
q
1
(
t
)
]
N
-
m
×
(
(
1
-
δ
1
)
θ
1
s
(
t
)
+
δ
1
π
~
1
(
t
)
+
λ
m
-
λ
n
)
=
(
1
-
δ
1
)
θ
1
s
(
t
)
+
δ
1
π
~
1
(
t
)
+
λ
N
q
1
(
t
)
-
λ
N
(
1
-
q
1
(
t
)
)
=
(
1
-
δ
1
)
θ
1
s
(
t
)
+
δ
1
π
~
1
(
t
)
+
λ
(
2
q
1
(
t
)
-
1
)
,
where q
1
=
α
q
1
s
+
(
1
-
α
)
q
1
a. Similarly, when consumers do not buy good 1,
(15)
θ
1
s
(
t
+
1
)
=
(
1
-
δ
2
)
θ
1
s
(
t
)
+
λ
(
1
-
2
q
1
(
t
)
)
.Then we obtain the updating rule of sophisticated consumers as follows.Proposition 8.
The continuous updating rule of sophisticated consumers’ is(16)
θ
˙
1
s
=
q
1
s
π
1
-
q
1
s
θ
1
s
+
ω
(
q
1
s
θ
1
s
-
θ
1
s
)
+
σ
(
2
q
1
-
1
)
(
2
q
1
s
-
1
)
θ
˙
2
s
=
q
2
s
π
2
-
q
2
s
θ
2
s
+
ω
(
q
2
s
θ
2
s
-
θ
2
s
)
+
σ
(
2
q
2
-
1
)
(
2
q
2
s
-
1
)
.The poof of Proposition8 is similar with the poof of Proposition 2. If α
=
0, there is only adaptive consumers in the market, namely, the experience inspired model. If α
=
1, there is only sophisticated consumers in the market, namely, the AQRE model. σ
=
λ
/
δ
1 and it is apparent that sophisticated consumers become adaptive consumers if λ
=
0, and the larger λ is, the greater effect on sophisticated consumers’ purchase decision from other consumers.


### 3.3. Equilibrium Analysis of Dynamic Pricing Model

We also suppose the two firms producing a product at a constant marginal cost and marginal cost for both brands is normalized to zero. Based on the assumption in Sections3.1 and 3.2, the maximization function of firm’s long-term profit is
(17)
∫
t
=
0
∞
e
-
r
t
p
i
q
i
(
u
,
p
)
d
t
(
i
=
1,2
)
subject to
(18)
θ
˙
1
a
=
q
1
a
π
1
-
q
1
a
θ
1
a
+
ω
(
q
1
a
θ
1
a
-
θ
1
a
)
θ
˙
2
a
=
q
2
a
π
2
-
q
2
a
θ
2
a
+
ω
(
q
2
a
θ
2
a
-
θ
2
a
)
θ
˙
1
s
=
q
1
s
π
1
-
q
1
s
θ
1
s
+
ω
(
q
1
s
θ
1
s
-
θ
1
s
)
+
σ
(
2
q
1
-
1
)
(
2
q
1
s
-
1
)
θ
˙
2
s
=
q
2
s
π
2
-
q
2
s
θ
2
s
+
ω
(
q
2
s
θ
2
s
-
θ
2
s
)
+
σ
(
2
q
2
-
1
)
(
2
q
2
s
-
1
)
.By analyzing (17) and (18), we obtain the following steady states of Nash equilibrium.Proposition 9.
The steady states of Nash equilibrium for open-loop satisfy(19)
η
a
=
q
1
a
π
1
(
q
1
a
-
ω
q
1
a
+
ω
)
-
q
2
a
π
2
(
q
2
a
-
ω
q
2
a
+
ω
)
η
s
=
q
1
s
π
1
+
σ
(
2
q
1
-
1
)
(
2
q
1
s
-
1
)
q
1
s
-
ω
q
1
s
+
ω
-
q
2
s
π
2
+
σ
(
2
q
2
-
1
)
(
2
q
2
s
-
1
)
q
2
s
-
ω
q
2
s
+
ω
ρ
=
-
q
1
-
q
2
A
+
C
A
(
ν
1
a
Φ
21
-
μ
1
a
Φ
11
+
μ
2
a
Φ
12
-
ν
2
a
Φ
22
)
+
B
A
(
ν
1
s
Φ
41
-
μ
1
s
Φ
31
+
μ
2
s
Φ
32
-
ν
2
s
Φ
42
)
+
2
σ
(
ν
1
s
(
2
q
2
s
-
1
)
-
μ
1
s
(
2
q
1
s
-
1
)
+
μ
2
s
(
2
q
2
s
-
1
)
-
ν
2
s
(
2
q
1
s
-
1
)
)
+
2
σ
B
A
(
ν
1
s
(
2
q
2
-
1
)
-
μ
1
s
(
2
q
1
-
1
)
+
μ
2
s
(
2
q
2
-
1
)
-
ν
2
s
(
2
q
1
-
1
)
)
,
where
(20)
A
=
α
(
-
β
q
i
s
(
1
-
q
i
s
)
)
+
(
1
-
α
)
(
-
β
q
i
a
(
1
-
q
i
a
)
)
B
=
-
β
q
i
s
(
1
-
q
i
s
)
C
=
-
β
q
i
a
(
1
-
q
i
a
)
M
i
=
-
q
j
a
-
ω
q
j
a
+
ω
+
r
q
i
a
-
ω
q
i
a
+
ω
+
r
N
i
=
-
q
j
s
-
ω
q
j
s
+
ω
+
r
q
i
s
-
ω
q
i
s
+
ω
+
r
Φ
22
=
Φ
11
=
ω
π
1
q
1
a
-
ω
q
1
a
+
ω
Φ
12
=
Φ
21
=
ω
π
2
q
2
a
-
ω
q
2
a
+
ω
Φ
42
=
Φ
31
=
ω
π
1
q
1
s
-
ω
q
1
s
+
ω
Φ
32
=
Φ
41
=
ω
π
2
q
2
s
-
ω
q
2
s
+
ω
μ
i
a
=
-
q
j
a
-
ω
q
j
a
+
ω
+
r
q
i
a
-
ω
q
i
a
+
ω
+
r
v
i
a
μ
i
s
=
-
q
j
s
-
ω
q
j
s
+
ω
+
r
q
i
s
-
ω
q
i
s
+
ω
+
r
v
i
s
[
q
j
a
-
ω
q
j
a
+
ω
+
r
]
v
i
a
+
[
q
j
s
-
ω
q
j
s
+
ω
+
r
]
v
i
s
=
-
q
i
v
i
s
=
α
B
A
[
1
-
C
Φ
1
M
-
Φ
2
q
j
a
-
ω
q
j
a
+
ω
+
r
]
×
q
i
×
{
(
α
B
2
A
-
B
)
α
B
C
A
(
Φ
1
M
-
Φ
2
)
q
j
s
-
ω
q
j
s
+
ω
+
r
q
j
a
-
ω
q
j
a
+
ω
+
r
-
(
α
B
2
A
-
B
)
(
Φ
3
N
-
Φ
4
)
-
2
σ
(
α
B
2
A
-
B
)
×
(
2
q
i
-
1
)
(
M
+
1
)
-
(
q
j
s
-
ω
q
j
s
+
ω
+
r
)
(
α
B
2
A
-
B
)
}
-
1
.Proof.
See the Appendix.Equations (19) are the requirements which steady-state solutions must meet. According to these equations, consumers’ choosing probability q
i
s is nonlinear, so the steady-state solution is also nonlinear, and the steady-state may have multiple solutions.


### 3.4. Numerical Results

In fact, (19) has three different steady-state solutions. For example, we assume π
1
=
π
2
=
π. That is, the two goods are completely identical. If π
=
2, r
=
1, β
=
2, ω
=
0.5, and σ
=
4, there are three groups of steady-state solutions for (
η
a
,
η
s
,
p
1
,
p
2
), we get (
-
0.3571
,
-
0.4100,0.2491,0.3979
), (
0,0
,
0,0
), and (
0.3571,0.4100,0.3979,0.2491
). Respectively, the corresponding probabilities q
1
a, q
1
s are (
0.4,0.37
), (
0.5,0.5
), and (
0.6,0.63
).Compared with the steady states of dynamic pricing model which only considers adaptive consumers in the last section, the relative market share of two firms is less in the steady states obtained from this section. Whether there are sophisticated consumers in the market, the cognition degree of sophisticated consumers is mainly reflected in the value ofσ in the model. So, we then analyze the relationship between the steady-state solution and the value of σ. In the steady-state solutions, the relationship among q
1
a, q
1
s, and σ is shown in Figures 5 and 6.Figure 5
The relationship betweenσ and q
1
a.Figure 6
The relationship betweenσ and q
1
s.As we can see from Figures5 and 6, the steady state is gradually convergent with the increasing of σ. That is to say, in case of different perception for the same quality products, the market share disparity is smaller in the steady state of sophisticated learning situation than that of self-adaptive learning situation. Compared to the market where only exist adaptive consumers, when there are also sophisticated consumers and if η
a
(
0
), η
s
(
0
) is small but positive; the firm 1 should choose a lower price which will place him on the third stable state. The market share of firm 1 is less. This indicates that when there are sophisticated consumers in the market, the firms’ income is less than the case that there are only adaptive consumers in the market simply by raising initial evaluation of consumers for the commodity. Therefore, when faced with sophisticated consumers, firms should not only raise the initial evaluation of consumers for the commodity but also improve product quality to increase market share.


## 3.1. Choice Probabilities

Same as the adaptive consumers, the sophisticated consumers’ choice probability can be given as(12)
q
1
s
=
e
β
A
1
s
e
β
A
1
s
+
e
β
A
2
s
=
e
β
(
θ
1
s
-
p
1
)
e
β
(
θ
1
s
-
p
1
)
+
e
β
(
θ
2
s
-
p
2
)
=
e
β
(
η
s
-
ρ
)
e
β
(
η
s
-
ρ
)
+
1
and q
2
s
=
1
-
q
1
s. Where θ
s
=
(
θ
1
s
,
θ
2
s
) is the sophisticated consumers’ estimate for the quality or goodwill of good and η
s
=
θ
1
s
-
θ
2
s is the relative quality or goodwill of two goods for sophisticated. According to (12), the consumers’ choosing probability q
i
s (i
=
1,2
) is nonlinear. The nonlinearity arises from the nonlinearity of the demand function q
1
s
(
η
s
,
ρ
) and the degree of its nonlinearity depends on the optimization parameter β. For example, if β is very small, q
1
s
(
η
s
,
ρ
)
≈
1
/
2
+
β
(
η
s
-
ρ
)
/
4 approximates a linear function.We assume the customers in the market as a whole (N
=
1) as in Section 2.1. So the total demand of the market is q
1
=
α
q
1
s
+
(
1
-
α
)
q
1
a.


## 3.2. Updating Rules

Because sophisticated consumers are easily influenced by other consumers when they make purchase decisions. We assume that, for a consumer, the more the goods he buys, the better the quality of the goods is. In other words, the less he purchases, the poorer the quality is. Therefore, we assume that the credit evaluation for sophisticated consumers after purchasing good 1 is(13)
θ
1
s
(
s
1
s
,
s
i
k
)
=
(
1
-
δ
1
)
θ
1
s
(
t
)
+
δ
1
π
~
1
(
t
)
+
λ
m
-
λ
n
,
where s
1
s represents sophisticated consumers’ strategy for purchasing good 1. s
i
k means other consumers’ purchase strategy. m is the number of customers buying good 1, while n is those who buy good 2. So the overall number of customers in the market is N
=
m
+
n. Considering customers on the market as a whole, we get N
=
1.According to the SEWA model proposed by Camerer et al. [2], we have
(14)
θ
1
s
(
t
+
1
)
=
∑
k
=
1
m
-
i
[
α
q
1
s
(
t
)
+
(
1
-
α
)
·
q
1
a
(
t
)
]
θ
1
s
(
s
1
s
,
s
i
k
)
=
∑
m
=
0
N
C
N
m
[
q
1
(
t
)
]
m
[
1
-
q
1
(
t
)
]
N
-
m
×
(
(
1
-
δ
1
)
θ
1
s
(
t
)
+
δ
1
π
~
1
(
t
)
+
λ
m
-
λ
n
)
=
(
1
-
δ
1
)
θ
1
s
(
t
)
+
δ
1
π
~
1
(
t
)
+
λ
N
q
1
(
t
)
-
λ
N
(
1
-
q
1
(
t
)
)
=
(
1
-
δ
1
)
θ
1
s
(
t
)
+
δ
1
π
~
1
(
t
)
+
λ
(
2
q
1
(
t
)
-
1
)
,
where q
1
=
α
q
1
s
+
(
1
-
α
)
q
1
a. Similarly, when consumers do not buy good 1,
(15)
θ
1
s
(
t
+
1
)
=
(
1
-
δ
2
)
θ
1
s
(
t
)
+
λ
(
1
-
2
q
1
(
t
)
)
.Then we obtain the updating rule of sophisticated consumers as follows.Proposition 8.
The continuous updating rule of sophisticated consumers’ is(16)
θ
˙
1
s
=
q
1
s
π
1
-
q
1
s
θ
1
s
+
ω
(
q
1
s
θ
1
s
-
θ
1
s
)
+
σ
(
2
q
1
-
1
)
(
2
q
1
s
-
1
)
θ
˙
2
s
=
q
2
s
π
2
-
q
2
s
θ
2
s
+
ω
(
q
2
s
θ
2
s
-
θ
2
s
)
+
σ
(
2
q
2
-
1
)
(
2
q
2
s
-
1
)
.The poof of Proposition8 is similar with the poof of Proposition 2. If α
=
0, there is only adaptive consumers in the market, namely, the experience inspired model. If α
=
1, there is only sophisticated consumers in the market, namely, the AQRE model. σ
=
λ
/
δ
1 and it is apparent that sophisticated consumers become adaptive consumers if λ
=
0, and the larger λ is, the greater effect on sophisticated consumers’ purchase decision from other consumers.


## 3.3. Equilibrium Analysis of Dynamic Pricing Model

We also suppose the two firms producing a product at a constant marginal cost and marginal cost for both brands is normalized to zero. Based on the assumption in Sections3.1 and 3.2, the maximization function of firm’s long-term profit is
(17)
∫
t
=
0
∞
e
-
r
t
p
i
q
i
(
u
,
p
)
d
t
(
i
=
1,2
)
subject to
(18)
θ
˙
1
a
=
q
1
a
π
1
-
q
1
a
θ
1
a
+
ω
(
q
1
a
θ
1
a
-
θ
1
a
)
θ
˙
2
a
=
q
2
a
π
2
-
q
2
a
θ
2
a
+
ω
(
q
2
a
θ
2
a
-
θ
2
a
)
θ
˙
1
s
=
q
1
s
π
1
-
q
1
s
θ
1
s
+
ω
(
q
1
s
θ
1
s
-
θ
1
s
)
+
σ
(
2
q
1
-
1
)
(
2
q
1
s
-
1
)
θ
˙
2
s
=
q
2
s
π
2
-
q
2
s
θ
2
s
+
ω
(
q
2
s
θ
2
s
-
θ
2
s
)
+
σ
(
2
q
2
-
1
)
(
2
q
2
s
-
1
)
.By analyzing (17) and (18), we obtain the following steady states of Nash equilibrium.Proposition 9.
The steady states of Nash equilibrium for open-loop satisfy(19)
η
a
=
q
1
a
π
1
(
q
1
a
-
ω
q
1
a
+
ω
)
-
q
2
a
π
2
(
q
2
a
-
ω
q
2
a
+
ω
)
η
s
=
q
1
s
π
1
+
σ
(
2
q
1
-
1
)
(
2
q
1
s
-
1
)
q
1
s
-
ω
q
1
s
+
ω
-
q
2
s
π
2
+
σ
(
2
q
2
-
1
)
(
2
q
2
s
-
1
)
q
2
s
-
ω
q
2
s
+
ω
ρ
=
-
q
1
-
q
2
A
+
C
A
(
ν
1
a
Φ
21
-
μ
1
a
Φ
11
+
μ
2
a
Φ
12
-
ν
2
a
Φ
22
)
+
B
A
(
ν
1
s
Φ
41
-
μ
1
s
Φ
31
+
μ
2
s
Φ
32
-
ν
2
s
Φ
42
)
+
2
σ
(
ν
1
s
(
2
q
2
s
-
1
)
-
μ
1
s
(
2
q
1
s
-
1
)
+
μ
2
s
(
2
q
2
s
-
1
)
-
ν
2
s
(
2
q
1
s
-
1
)
)
+
2
σ
B
A
(
ν
1
s
(
2
q
2
-
1
)
-
μ
1
s
(
2
q
1
-
1
)
+
μ
2
s
(
2
q
2
-
1
)
-
ν
2
s
(
2
q
1
-
1
)
)
,
where
(20)
A
=
α
(
-
β
q
i
s
(
1
-
q
i
s
)
)
+
(
1
-
α
)
(
-
β
q
i
a
(
1
-
q
i
a
)
)
B
=
-
β
q
i
s
(
1
-
q
i
s
)
C
=
-
β
q
i
a
(
1
-
q
i
a
)
M
i
=
-
q
j
a
-
ω
q
j
a
+
ω
+
r
q
i
a
-
ω
q
i
a
+
ω
+
r
N
i
=
-
q
j
s
-
ω
q
j
s
+
ω
+
r
q
i
s
-
ω
q
i
s
+
ω
+
r
Φ
22
=
Φ
11
=
ω
π
1
q
1
a
-
ω
q
1
a
+
ω
Φ
12
=
Φ
21
=
ω
π
2
q
2
a
-
ω
q
2
a
+
ω
Φ
42
=
Φ
31
=
ω
π
1
q
1
s
-
ω
q
1
s
+
ω
Φ
32
=
Φ
41
=
ω
π
2
q
2
s
-
ω
q
2
s
+
ω
μ
i
a
=
-
q
j
a
-
ω
q
j
a
+
ω
+
r
q
i
a
-
ω
q
i
a
+
ω
+
r
v
i
a
μ
i
s
=
-
q
j
s
-
ω
q
j
s
+
ω
+
r
q
i
s
-
ω
q
i
s
+
ω
+
r
v
i
s
[
q
j
a
-
ω
q
j
a
+
ω
+
r
]
v
i
a
+
[
q
j
s
-
ω
q
j
s
+
ω
+
r
]
v
i
s
=
-
q
i
v
i
s
=
α
B
A
[
1
-
C
Φ
1
M
-
Φ
2
q
j
a
-
ω
q
j
a
+
ω
+
r
]
×
q
i
×
{
(
α
B
2
A
-
B
)
α
B
C
A
(
Φ
1
M
-
Φ
2
)
q
j
s
-
ω
q
j
s
+
ω
+
r
q
j
a
-
ω
q
j
a
+
ω
+
r
-
(
α
B
2
A
-
B
)
(
Φ
3
N
-
Φ
4
)
-
2
σ
(
α
B
2
A
-
B
)
×
(
2
q
i
-
1
)
(
M
+
1
)
-
(
q
j
s
-
ω
q
j
s
+
ω
+
r
)
(
α
B
2
A
-
B
)
}
-
1
.Proof.
See the Appendix.Equations (19) are the requirements which steady-state solutions must meet. According to these equations, consumers’ choosing probability q
i
s is nonlinear, so the steady-state solution is also nonlinear, and the steady-state may have multiple solutions.


## 3.4. Numerical Results

In fact, (19) has three different steady-state solutions. For example, we assume π
1
=
π
2
=
π. That is, the two goods are completely identical. If π
=
2, r
=
1, β
=
2, ω
=
0.5, and σ
=
4, there are three groups of steady-state solutions for (
η
a
,
η
s
,
p
1
,
p
2
), we get (
-
0.3571
,
-
0.4100,0.2491,0.3979
), (
0,0
,
0,0
), and (
0.3571,0.4100,0.3979,0.2491
). Respectively, the corresponding probabilities q
1
a, q
1
s are (
0.4,0.37
), (
0.5,0.5
), and (
0.6,0.63
).Compared with the steady states of dynamic pricing model which only considers adaptive consumers in the last section, the relative market share of two firms is less in the steady states obtained from this section. Whether there are sophisticated consumers in the market, the cognition degree of sophisticated consumers is mainly reflected in the value ofσ in the model. So, we then analyze the relationship between the steady-state solution and the value of σ. In the steady-state solutions, the relationship among q
1
a, q
1
s, and σ is shown in Figures 5 and 6.Figure 5
The relationship betweenσ and q
1
a.Figure 6
The relationship betweenσ and q
1
s.As we can see from Figures5 and 6, the steady state is gradually convergent with the increasing of σ. That is to say, in case of different perception for the same quality products, the market share disparity is smaller in the steady state of sophisticated learning situation than that of self-adaptive learning situation. Compared to the market where only exist adaptive consumers, when there are also sophisticated consumers and if η
a
(
0
), η
s
(
0
) is small but positive; the firm 1 should choose a lower price which will place him on the third stable state. The market share of firm 1 is less. This indicates that when there are sophisticated consumers in the market, the firms’ income is less than the case that there are only adaptive consumers in the market simply by raising initial evaluation of consumers for the commodity. Therefore, when faced with sophisticated consumers, firms should not only raise the initial evaluation of consumers for the commodity but also improve product quality to increase market share.


## 4. Conclusion

This paper considers the dynamic pricing problems of experience goods in a duopoly market. First of all, we presented the self-adaptive learning model based on EWA model and applied the model to deal with dynamic pricing problems. With the concept of open-loop equilibrium, we gained groups of steady-state solutions when using nonlinear dynamic programming. In the analysis of steady-state solutions, we get that there will be a dominant company in the symmetrical steady-state solutions. Secondly, we put forward a sophisticated learning model on the basis of previous studies and applied it to dynamic pricing as well. The dynamic pricing model of sophisticated learning also has multiple steady-state solutions, and there must be one firm dominating when a symmetric steady-state solution exists, which is similar to the self-adaptive learning dynamic pricing model based on EWA. But in the dynamic pricing model based on sophisticated learning, differences of market share between the two firms decrease when the steady-state solution is symmetric. This shows that, compared with the adaptive consumers, sophisticated consumers less easily become locked into the habit of purchasing inferior goods. Therefore, with the market existing sophisticated consumers, firms should not only improve consumers’ initial evaluation but also devote themselves to improving the quality of products, so as to occupy the dominate status in the market. While there are most adaptive consumers in the market, firms can successfully make parts of naive consumers obsessed only by increasing consumers’ initial evaluation on their products. This paper studies dynamic pricing problems of experience goods in a duopoly market. However, there are lots of firms producing experience goods in the market. Hence, future research can consider the case of many firms in the market. Meanwhile, we assume that consumers are homogeneous and do not consider heterogeneous consumers. Furthermore, in reality, decision makers are always in front of imprecise and vague operational conditions [25]. Uncertainties have been tackled in a lot of ways and fuzzy set theory has a long history for handling imprecise values [26].



---

*Source: 791656-2014-03-20.xml*