Directional derivative

In mathematics, the **directional derivative** of a multivariate differentiable function along a given vector **v** at a given point **x** intuitively represents the instantaneous rate of change of the function, moving through **x** with a velocity specified by **v**. It therefore generalizes the notion of a partial derivative, in which the rate of change is taken along one of the curvilinear coordinate curves, all other coordinates being constant.

The directional derivative is a special case of the Gateaux derivative.

## Notation

Let *f*  be a curve whose tangent vector at some chosen point is **v**. The directional derivative of a function *f* with respect to **v** may be denoted by any of the following:

* ∇

v

f

(

x

)
,

{\displaystyle \nabla\_{\mathbf{v}}{f}(\mathbf{x}),}
* f

v

′

(

x

)
,

{\displaystyle f'\_\mathbf{v}(\mathbf{x}),}
* D

v

f
(

x

)
,

{\displaystyle D\_\mathbf{v}f(\mathbf{x}),}
* D
f
(

x

)
(

v

)
,

{\displaystyle Df(\mathbf{x})(\mathbf{v}),}
* ∂

v

f
(

x

)
,

{\displaystyle \partial\_\mathbf{v}f(\mathbf{x}),}
* ∂

f
(

x

)

∂

v

,

{\displaystyle \frac{\partial{f(\mathbf{x})}}{\partial{\mathbf{v}}},}
* v

⋅

∇
f
(

x

)

,

{\displaystyle \mathbf{v}\cdot{\nabla f(\mathbf{x})},}
* v

⋅

∂
f
(

x

)

∂

x

.

{\displaystyle \mathbf{v}\cdot \frac{\partial f(\mathbf{x})}{\partial\mathbf{x}}.}

## Definition

The *directional derivative* of a scalar function

f
(

x

# )
f
(

x
1

,

x
2

,
…
,

x
n

)

{\displaystyle f(\mathbf{x}) = f(x\_1, x\_2, \ldots, x\_n)}

along a vector

v

=
(

v
1

,
…
,

v
n

)

{\displaystyle \mathbf{v} = (v\_1, \ldots, v\_n)}

is the function

∇

v

f

{\displaystyle \nabla\_{\mathbf{v}}{f}}

 defined by the limit

∇

v

f

(

x

# )

lim

h
→
0

f
(

x

h

v

)
−
f
(

x

)

h

.

{\displaystyle \nabla\_{\mathbf{v}}{f}(\mathbf{x}) = \lim\_{h \rightarrow 0}{\frac{f(\mathbf{x} + h\mathbf{v}) - f(\mathbf{x})}{h}}.}

This definition is valid in a broad range of contexts, for example where the norm of a vector (and hence a unit vector) is undefined.

If the function *f* is differentiable at **x**, then the directional derivative exists along any vector **v**, and one has

∇

v

f

(

x

# )
∇
f
(

x

)
⋅

v

{\displaystyle \nabla\_{\mathbf{v}}{f}(\mathbf{x}) = \nabla f(\mathbf{x}) \cdot \mathbf{v}}

where the

∇

{\displaystyle \nabla }

 on the right denotes the gradient and

⋅

{\displaystyle \cdot}

 is the dot product. This follows from defining a path

h
(
t
# )
x
t
v

{\displaystyle h(t)=x+tv}

 and using the definition of the derivative as a limit which can be calculated along this path to get:

# 0

lim

t
→
0

f
(
x
t
v
)
−
f
(
x
)
−
t

D
f

(
x
)
(
v
)

t

=

lim

t
→
0

f
(
x
t
v
)
−
f
(
x
)

t

−

D
f

(
x
)
(
v
# )

∇
v

f
(
x
)
−

D
f

(
x
)
(
v
)

→
∇
f
(

x

)
⋅

v

=

D
f

(
x
)
(
v
# )

∇

v

f

(

x

)

{\displaystyle
\begin{align}
0=\lim\_{t\rightarrow 0}\frac {f(x+tv)-f(x)-tD\_f(x)(v)} t =\lim\_{t\rightarrow 0}\frac {f(x+tv)-f(x)} t - D\_f(x)(v)=\nabla\_v f(x)-D\_f(x)(v) \\
 \rightarrow \nabla f(\mathbf{x}) \cdot \mathbf{v}=D\_f(x)(v)=\nabla\_{\mathbf{v}}{f}(\mathbf{x})
\end{align}
}

Intuitively, the directional derivative of *f* at a point **x** represents the rate of change of *f*, in the direction of **v** with respect to time, when moving past **x**.

### Using only direction of vector

In a Euclidean space, some authors define the directional derivative to be with respect to an arbitrary nonzero vector **v** after normalization, thus being independent of its magnitude and depending only on its direction.

This definition gives the rate of increase of *f* per unit of distance moved in the direction given by **v**. In this case, one has

∇

v

f

(

x

# )

lim

h
→
0

f
(

x

h

v

)
−
f
(

x

)

h

v

,

{\displaystyle \nabla\_{\mathbf{v}}{f}(\mathbf{x}) = \lim\_{h \rightarrow 0}{\frac{f(\mathbf{x} + h\mathbf{v}) - f(\mathbf{x})}{h|\mathbf{v}|}},}

or in case *f* is differentiable at **x**,

∇

v

f

(

x

# )
∇
f
(

x

)
⋅

v

v

.

{\displaystyle \nabla\_{\mathbf{v}}{f}(\mathbf{x}) = \nabla f(\mathbf{x}) \cdot \frac{\mathbf{v}}{|\mathbf{v}|} .}

### Restriction to a unit vector

In the context of a function on a Euclidean space, some texts restrict the vector **v** to being a unit vector. With this restriction, both the above definitions are equivalent.

## Properties

Many of the familiar properties of the ordinary derivative hold for the directional derivative. These include, for any functions *f* and *g* defined in a neighborhood of, and differentiable at, **p**:

1. **sum rule**:

∇

v

(
f
g
# )

∇

v

f

∇

v

g
.

{\displaystyle \nabla\_{\mathbf{v}} (f + g) = \nabla\_{\mathbf{v}} f + \nabla\_{\mathbf{v}} g.}
2. **constant factor rule**: For any constant *c*,

∇

v

(
c
f
# )
c

∇

v

f
.

{\displaystyle \nabla\_{\mathbf{v}} (cf) = c\nabla\_{\mathbf{v}} f.}
3. **product rule** (or **Leibniz's rule**):

∇

v

(
f
g
# )
g

∇

v

f
f

∇

v

g
.

{\displaystyle \nabla\_{\mathbf{v}} (fg) = g\nabla\_{\mathbf{v}} f + f\nabla\_{\mathbf{v}} g.}
4. **chain rule**: If *g* is differentiable at **p** and *h* is differentiable at *g*(**p**), then

∇

v

(
h
∘
g
)
(

p

# )

h
′

(
g
(

p

)
)

∇

v

g
(

p

)
.

{\displaystyle \nabla\_{\mathbf{v}}(h\circ g)(\mathbf{p}) = h'(g(\mathbf{p})) \nabla\_{\mathbf{v}} g (\mathbf{p}).}

## In differential geometry

See also: Tangent space#Tangent vectors as directional derivatives
Let *M* be a differentiable manifold and **p** a point of *M*. Suppose that *f* is a function defined in a neighborhood of **p**, and differentiable at **p**. If **v** is a tangent vector to *M* at **p**, then the **directional derivative** of *f* along **v**, denoted variously as *df*(**v**) (see Exterior derivative),

∇

v

f
(

p

)

{\displaystyle \nabla\_{\mathbf{v}} f(\mathbf{p})}

 (see Covariant derivative),

L

v

f
(

p

)

{\displaystyle L\_{\mathbf{v}} f(\mathbf{p})}

 (see Lie derivative), or

v

p

(
f
)

{\displaystyle {\mathbf{v}}\_{\mathbf{p}}(f)}

 (see Tangent space § Definition via derivations), can be defined as follows. Let *γ* : [−1, 1] → *M* be a differentiable curve with *γ*(0) = **p** and *γ*′(0) = **v**. Then the directional derivative is defined by

∇

v

f
(

p

# )

d

d
τ

f
∘
γ
(
τ
)

# τ
0

.

{\displaystyle \nabla\_{\mathbf{v}} f(\mathbf{p}) = \left.\frac{d}{d\tau} f\circ\gamma(\tau)\right|\_{\tau=0}.}

This definition can be proven independent of the choice of *γ*, provided *γ* is selected in the prescribed manner so that *γ*′(0) = **v**.

### The Lie derivative

The Lie derivative of a vector field

W
μ

(
x
)

{\displaystyle \scriptstyle W^\mu(x)}

 along a vector field

V
μ

(
x
)

{\displaystyle \scriptstyle V^\mu(x)}

 is given by the difference of two directional derivatives (with vanishing torsion):

L

V

W
μ

=
(
V
⋅
∇
)

W
μ

−
(
W
⋅
∇
)

V
μ

.

{\displaystyle \mathcal{L}\_V W^\mu=(V\cdot\nabla) W^\mu-(W\cdot\nabla) V^\mu.}

In particular, for a scalar field

ϕ
(
x
)

{\displaystyle \scriptstyle \phi(x)}

, the Lie derivative reduces to the standard directional derivative:

L

V

# ϕ
(
V
⋅
∇
)
ϕ
.

{\displaystyle \mathcal{L}\_V \phi=(V\cdot\nabla) \phi.}

### The Riemann tensor

Directional derivatives are often used in introductory derivations of the Riemann curvature tensor. Consider a curved rectangle with an infinitesimal vector *δ* along one edge and *δ*′ along the other. We translate a covector *S* along *δ* then *δ*′ and then subtract the translation along *δ*′ and then *δ*. Instead of building the directional derivative using partial derivatives, we use the covariant derivative. The translation operator for *δ* is thus

1

∑
ν

δ
ν

D
ν

=
1
δ
⋅
D
,

{\displaystyle 1+\sum\_\nu \delta^\nu D\_\nu=1+\delta\cdot D,}

and for *δ*′,

1

∑
μ

δ

′
μ

D
μ

=
1

δ
′

⋅
D
.

{\displaystyle 1+\sum\_\mu \delta'^\mu D\_\mu=1+\delta'\cdot D.}

The difference between the two paths is then

(
1

δ
′

⋅
D
)
(
1
δ
⋅
D
)

S
ρ

−
(
1
δ
⋅
D
)
(
1

δ
′

⋅
D
)

S
ρ

=

∑

μ
,
ν

δ

′
μ

δ
ν

[

D
μ

,

D
ν

]

S
ρ

.

{\displaystyle (1+\delta'\cdot D)(1+\delta\cdot D)S^\rho-(1+\delta\cdot D)(1+\delta'\cdot D)S^\rho=\sum\_{\mu,\nu}\delta'^\mu \delta^\nu[D\_\mu,D\_\nu]S\_\rho.}

It can be argued that the noncommutativity of the covariant derivatives measures the curvature of the manifold:

[

D
μ

,

D
ν

]

S
ρ

=
±

∑
σ

R
σ

ρ
μ
ν

S
σ

,

{\displaystyle [D\_\mu,D\_\nu]S\_\rho=\pm \sum\_\sigma R^\sigma{}\_{\rho\mu\nu}S\_\sigma,}

where *R* is the Riemann curvature tensor and the sign depends on the sign convention of the author.

## In group theory

### Translations

In the Poincaré algebra, we can define an infinitesimal translation operator **P** as

P

=
i
∇
.

{\displaystyle \mathbf{P}=i\nabla.}

(the i ensures that **P** is a self-adjoint operator) For a finite displacement **λ**, the unitary Hilbert space representation for translations is

U
(

λ

# )
exp
⁡

(

−
i

λ

⋅

P

)

.

{\displaystyle U(\mathbf{\lambda})=\exp\left(-i\mathbf{\lambda}\cdot\mathbf{P}\right).}

By using the above definition of the infinitesimal translation operator, we see that the finite translation operator is an exponentiated directional derivative:

U
(

λ

# )
exp
⁡

(

λ

⋅
∇

)

.

{\displaystyle U(\mathbf{\lambda})=\exp\left(\mathbf{\lambda}\cdot\nabla\right).}

This is a translation operator in the sense that it acts on multivariable functions f(**x**) as

U
(

λ

)
f
(

x

# )
exp
⁡

(

λ

⋅
∇

)

f
(

x

# )
f
(

x

λ

)
.

{\displaystyle U(\mathbf{\lambda}) f(\mathbf{x})=\exp\left(\mathbf{\lambda}\cdot\nabla\right) f(\mathbf{x})=f(\mathbf{x}+\mathbf{\lambda}).}

d
f

d
x

=

f
(
x
ϵ
)
−
f
(
x
)

ϵ

.

{\displaystyle \frac{df}{dx}=\frac{f(x+\epsilon)-f(x)}{\epsilon}.}

This can be rearranged to find f(x+ε):

f
(
x
ϵ
# )
f
(
x
)
ϵ

d
f

d
x

=

(

1
ϵ

d

d
x

)

f
(
x
)
.

{\displaystyle f(x+\epsilon)=f(x)+\epsilon \,\frac{df}{dx}=\left(1+\epsilon\,\frac{d}{dx}\right)f(x).}

It follows that

[
1
ϵ

(
d

/

d
x
)
]

{\displaystyle [1+\epsilon\,(d/dx)] }

 is a translation operator. This is instantly generalized to multivariable functions f(**x**)

f
(

x

ϵ

# )

(

1

ϵ

⋅
∇

)

f
(

x

)
.

{\displaystyle f(\mathbf{x}+\mathbf{\epsilon})=\left(1+\mathbf{\epsilon}\cdot\nabla\right)f(\mathbf{x}).}

Here

ϵ

⋅
∇

{\displaystyle \mathbf{\epsilon}\cdot\nabla}

 is the directional derivative along the infinitesimal displacement **ε**. We have found the infinitesimal version of the translation operator:

U
(

ϵ

# )
1

ϵ

⋅
∇
.

{\displaystyle U(\mathbf{\epsilon})=1+\mathbf{\epsilon}\cdot\nabla.}

It is evident that the group multiplication law U(g)U(f)=U(gf) takes the form

U
(

a

)
U
(

b

# )
U
(

a
b

)
.

{\displaystyle U(\mathbf{a})U(\mathbf{b})=U(\mathbf{a+b}).}

So suppose that we take the finite displacement **λ** and divide it into N parts (N→∞ is implied everywhere), so that **λ**/N=**ε**. In other words,

λ

=
N

ϵ

.

{\displaystyle \mathbf{\lambda}=N\mathbf{\epsilon}.}

Then by applying U(**ε**) N times, we can construct U(**λ**):

[
U
(

ϵ

)

]
N

=
U
(
N

ϵ

# )
U
(

λ

)
.

{\displaystyle [U(\mathbf{\epsilon})]^N=U(N\mathbf{\epsilon})=U(\mathbf{\lambda}).}

We can now plug in our above expression for U(**ε**):

[
U
(

ϵ

)

]
N

=

[

1

ϵ

⋅
∇

]

N

=

[

1

λ

⋅
∇

N

]

N

.

{\displaystyle [U(\mathbf{\epsilon})]^N=\left[1+\mathbf{\epsilon}\cdot\nabla\right]^N=\left[1+\frac{\mathbf{\lambda}\cdot\nabla}{N}\right]^N.}

Using the identity

exp
⁡
(
x
# )

[

1

x
N

]

N

,

{\displaystyle \exp(x)=\left[1+\frac{x}{N}\right]^N,}

we have

U
(

λ

# )
exp
⁡

(

λ

⋅
∇

)

.

{\displaystyle U(\mathbf{\lambda})=\exp\left(\mathbf{\lambda}\cdot\nabla\right).}

And since U(**ε**)f(**x**)=f(**x**+**ε**) we have

[
U
(

ϵ

)

]
N

f
(

x

# )
f
(

x

N

ϵ

# )
f
(

x

λ

# )
U
(

λ

)
f
(

x

# )
exp
⁡

(

λ

⋅
∇

)

f
(

x

)
,

{\displaystyle [U(\mathbf{\epsilon})]^Nf(\mathbf{x})=f(\mathbf{x}+N\mathbf{\epsilon})=f(\mathbf{x}+\mathbf{\lambda})=U(\mathbf{\lambda})f(\mathbf{x})=\exp\left(\mathbf{\lambda}\cdot\nabla\right)f(\mathbf{x}),}

Q.E.D.
As a technical note, this procedure is only possible because the translation group forms an Abelian subgroup (Cartan subalgebra) in the Poincaré algebra. In particular, the group multiplication law U(**a**)U(**b**)=U(**a**+**b**) should not be taken for granted. We also note that Poincaré is a connected Lie group. It is a group of transformations T(ξ) that are described by a continuous set of real parameters

ξ
a

{\displaystyle \scriptstyle \xi^a}

. The group multiplication law takes the form

T
(

ξ
¯

)
T
(
ξ
# )
T
(
f
(

ξ
¯

,
ξ
)
)
.

{\displaystyle T(\bar{\xi})T(\xi)=T(f(\bar{\xi},\xi)).}

Taking

ξ
a

{\displaystyle \scriptstyle \xi^a}

=0 as the coordinates of the identity, we must have

f
a

(
ξ
,
0
# )

f
a

(
0
,
ξ
# )

ξ
a

.

{\displaystyle f^a(\xi,0)=f^a(0,\xi)=\xi^a.}

The actual operators on the Hilbert space are represented by unitary operators U(T(ξ)). In the above notation we suppressed the T; we now write U(**λ**) as U(**P**(**λ**)). For a small neighborhood around the identity, the power series representation

U
(
T
(
ξ
)
# )
1
i

∑
a

ξ
a

t
a

1
2

∑

b
,
c

ξ
b

ξ
c

t

b
c

⋯

{\displaystyle U(T(\xi))=1+i\sum\_a\xi^a t\_a+\frac{1}{2}\sum\_{b,c}\xi^b\xi^c t\_{bc}+\cdots}

is quite good. Suppose that U(T(ξ)) form a non-projective representation, i.e. that

U
(
T
(

ξ
¯

)
)
U
(
T
(
ξ
)
# )
U
(
T
(
f
(

ξ
¯

,
ξ
)
)
)
.

{\displaystyle U(T(\bar{\xi}))U(T(\xi))=U(T(f(\bar{\xi},\xi))).}

The expansion of f to second power is

f
a

(

ξ
¯

,
ξ
# )

ξ
a

ξ
¯

a

∑

b
,
c

f

a
b
c

ξ
¯

b

ξ
c

.

{\displaystyle f^a(\bar{\xi},\xi)=\xi^a+\bar{\xi}^a+\sum\_{b,c}f^{abc}\bar{\xi}^b\xi^c.}

After expanding the representation multiplication equation and equating coefficients, we have the nontrivial condition

t

b
c

=
−

t
b

t
c

−
i

∑
a

f

a
b
c

t
a

.

{\displaystyle t\_{bc}=-t\_b t\_c-i\sum\_a f^{abc}t\_a.}

Since

t

a
b

{\displaystyle \scriptstyle t\_{ab}}

 is by definition symmetric in its indices, we have the standard Lie algebra commutator:

[

t
b

,

t
c

# ]
i

∑
a

(
−

f

a
b
c

f

a
c
b

)

t
a

=
i

∑
a

C

a
b
c

t
a

,

{\displaystyle [t\_b, t\_c]=i\sum\_a(-f^{abc}+f^{acb})t\_a=i\sum\_a C^{abc}t\_a,}

with C the structure constant. The generators for translations are partial derivative operators, which commute:

[

∂

∂

x
b

,

∂

∂

x
c

]

=

{\displaystyle \left[\frac{\partial}{\partial x^b},\frac{\partial }{\partial x^c}\right]=0.}

This implies that the structure constants vanish and thus the quadratic coefficients in the f expansion vanish as well. This means that f is simply additive:

f
abelian
a

(

ξ
¯

,
ξ
# )

ξ
a

ξ
¯

a

,

{\displaystyle f^a\_\text{abelian}(\bar{\xi},\xi)=\xi^a+\bar{\xi}^a,}

and thus for abelian groups,

U
(
T
(

ξ
¯

)
)
U
(
T
(
ξ
)
# )
U
(
T
(

ξ
¯

ξ
)
)
.

{\displaystyle U(T(\bar{\xi}))U(T(\xi))=U(T(\bar{\xi}+\xi)).}

Q.E.D.

### Rotations

The rotation operator also contains a directional derivative. The rotation operator for an angle **θ**, i.e. by an amount θ=|**θ**| about an axis parallel to

θ
^

{\displaystyle \scriptstyle \hat{\theta}}

=**θ**/θ is

U
(
R
(

θ

)
# )
exp
⁡
(
−
i

θ

⋅

L

)
.

{\displaystyle U(R(\mathbf{\theta}))=\exp(-i\mathbf{\theta}\cdot\mathbf{L}).}

Here **L** is the vector operator that generates SO(3):

L

=

(

0

0

0

0

0

1

0

−
1

0

)

i

(

0

0

−
1

0

0

0

1

0

0

)

j

(

0

1

0

−
1

0

0

0

0

0

)

k

.

{\displaystyle \mathbf{L}=\begin{pmatrix}
 0& 0 & 0\\
 0& 0 & 1\\
 0& -1 & 0
\end{pmatrix}\mathbf{i}+\begin{pmatrix}
0 &0 & -1\\
 0& 0 &0 \\
1 & 0 & 0
\end{pmatrix}\mathbf{j}+\begin{pmatrix}
 0&1 &0 \\
 -1&0 &0 \\
0 & 0 & 0
\end{pmatrix}\mathbf{k}.}

It may be shown geometrically that an infinitesimal right-handed rotation changes the position vector **x** by

x

→

x

−
δ

θ

×

x

.

{\displaystyle \mathbf{x}\rightarrow \mathbf{x}-\delta\mathbf{\theta}\times\mathbf{x}.}

So we would expect under infinitesimal rotation:

U
(
R
(
δ

θ

)
)
f
(

x

# )
f
(

x

−
δ

θ

×

x

# )
f
(

x

)
−
(
δ

θ

×

x

)
⋅
∇
f
.

{\displaystyle U(R(\delta\mathbf{\theta}))f(\mathbf{x})=f(\mathbf{x}-\delta\mathbf{\theta}\times\mathbf{x})=f(\mathbf{x})-(\delta\mathbf{\theta}\times\mathbf{x})\cdot\nabla f.}

It follows that

U
(
R
(
δ

θ

)
# )
1
−
(
δ

θ

×

x

)
⋅
∇
.

{\displaystyle U(R(\delta\mathbf{\theta}))=1-(\delta\mathbf{\theta}\times\mathbf{x})\cdot\nabla.}

Following the same exponentiation procedure as above, we arrive at the rotation operator in the position basis, which is an exponentiated directional derivative:

U
(
R
(

θ

)
# )
exp
⁡
(
−
(

θ

×

x

)
⋅
∇
)
.

{\displaystyle U(R(\mathbf{\theta}))=\exp(-(\mathbf{\theta}\times\mathbf{x})\cdot\nabla).}

## Normal derivative

A **normal derivative** is a directional derivative taken in the direction normal (that is, orthogonal) to some surface in space, or more generally along a normal vector field orthogonal to some hypersurface. See for example Neumann boundary condition. If the normal direction is denoted by

n

{\displaystyle \mathbf{n}}

, then the directional derivative of a function *f* is sometimes denoted as

∂
f

∂
n

{\displaystyle \frac{ \partial f}{\partial n}}

. In other notations,

∂
f

∂

n

=
∇
f
(

x

)
⋅

n

=

∇

n

f

(

x

# )

∂
f

∂

x

⋅

n

=
D
f
(

x

)
[

n

]
.

{\displaystyle \frac{ \partial f}{\partial \mathbf{n}} = \nabla f(\mathbf{x}) \cdot \mathbf{n} = \nabla\_{\mathbf{n}}{f}(\mathbf{x}) = \frac{\partial f}{\partial \mathbf{x}}\cdot\mathbf{n} = Df(\mathbf{x})[\mathbf{n}].}

## In the continuum mechanics of solids

Several important results in continuum mechanics require the derivatives of vectors with respect to vectors and of tensors with respect to vectors and tensors. The **directional directive** provides a systematic way of finding these derivatives.

The definitions of directional derivatives for various situations are given below. It is assumed that the functions are sufficiently smooth that derivatives can be taken.

### Derivatives of scalar-valued functions of vectors

Let

f
(

v

)

{\displaystyle f(\mathbf{v})}

 be a real-valued function of the vector

v

{\displaystyle \mathbf{v} }

. Then the derivative of

f
(

v

)

{\displaystyle f(\mathbf{v})}

 with respect to

v

{\displaystyle \mathbf{v} }

 (or at

v

{\displaystyle \mathbf{v} }

) in the direction

u

{\displaystyle \mathbf u}

 is defined as

∂
f

∂

v

⋅

u

=
D
f
(

v

)
[

u

# ]

[

d

d
α

f
(

v

α

u

)

]

# α
0

{\displaystyle
 \frac{\partial f}{\partial \mathbf{v}}\cdot\mathbf{u} = Df(\mathbf{v})[\mathbf{u}]
 = \left[\frac{d }{d \alpha}~f(\mathbf{v} + \alpha~\mathbf{u})\right]\_{\alpha = 0}
}

for all vectors

u

{\displaystyle \mathbf u}

.

*Properties:*

1. If

f
(

v

# )

f
1

(

v

)

f
2

(

v

)

{\displaystyle f(\mathbf{v}) = f\_1(\mathbf{v}) + f\_2(\mathbf{v})}

 then

∂
f

∂

v

⋅

u

=

(

∂

f
1

∂

v

∂

f
2

∂

v

)

⋅

u

.

{\displaystyle
 \frac{\partial f}{\partial \mathbf{v}}\cdot\mathbf{u} = \left(\frac{\partial f\_1}{\partial \mathbf{v}} + \frac{\partial f\_2}{\partial \mathbf{v}}\right)\cdot\mathbf{u}.
 }
2. If

f
(

v

# )

f
1

(

v

)

f
2

(

v

)

{\displaystyle f(\mathbf{v}) = f\_1(\mathbf{v})~ f\_2(\mathbf{v})}

 then

∂
f

∂

v

⋅

u

=

(

∂

f
1

∂

v

⋅

u

)

f
2

(

v

)

f
1

(

v

)

(

∂

f
2

∂

v

⋅

u

)

.

{\displaystyle
 \frac{\partial f}{\partial \mathbf{v}}\cdot\mathbf{u} = \left(\frac{\partial f\_1}{\partial \mathbf{v}}\cdot\mathbf{u}\right)~f\_2(\mathbf{v}) + f\_1(\mathbf{v})~\left(\frac{\partial f\_2}{\partial \mathbf{v}}\cdot\mathbf{u} \right).
 }
3. If

f
(

v

# )

f
1

(

f
2

(

v

)
)

{\displaystyle f(\mathbf{v}) = f\_1(f\_2(\mathbf{v}))}

 then

∂
f

∂

v

⋅

u

=

∂

f
1

∂

f
2

∂

f
2

∂

v

⋅

u

.

{\displaystyle
 \frac{\partial f}{\partial \mathbf{v}}\cdot\mathbf{u} = \frac{\partial f\_1}{\partial f\_2}~\frac{\partial f\_2}{\partial \mathbf{v}}\cdot\mathbf{u}.
 }

### Derivatives of vector-valued functions of vectors

Let

f

(

v

)

{\displaystyle \mathbf{f}(\mathbf{v})}

 be a vector-valued function of the vector

v

{\displaystyle \mathbf{v} }

. Then the derivative of

f

(

v

)

{\displaystyle \mathbf{f}(\mathbf{v})}

 with respect to

v

{\displaystyle \mathbf{v} }

 (or at

v

{\displaystyle \mathbf{v} }

) in the direction

u

{\displaystyle \mathbf u}

 is the **second-order tensor** defined as

∂

f

∂

v

⋅

u

=
D

f

(

v

)
[

u

# ]

[

d

d
α

f

(

v

α

u

)

]

# α
0

{\displaystyle
 \frac{\partial \mathbf{f}}{\partial \mathbf{v}}\cdot\mathbf{u} = D\mathbf{f}(\mathbf{v})[\mathbf{u}]
 = \left[\frac{d }{d \alpha}~\mathbf{f}(\mathbf{v} + \alpha~\mathbf{u})\right]\_{\alpha = 0}
}

for all vectors

u

{\displaystyle \mathbf u}

.

*Properties:*

1. If

f

(

v

# )

f

1

(

v

)

f

2

(

v

)

{\displaystyle \mathbf{f}(\mathbf{v}) = \mathbf{f}\_1(\mathbf{v}) + \mathbf{f}\_2(\mathbf{v})}

 then

∂

f

∂

v

⋅

u

=

(

∂

f

1

∂

v

∂

f

2

∂

v

)

⋅

u

.

{\displaystyle
 \frac{\partial \mathbf{f}}{\partial \mathbf{v}}\cdot\mathbf{u} = \left(\frac{\partial \mathbf{f}\_1}{\partial \mathbf{v}} + \frac{\partial \mathbf{f}\_2}{\partial \mathbf{v}}\right)\cdot\mathbf{u} .
 }
2. If

f

(

v

# )

f

1

(

v

)
×

f

2

(

v

)

{\displaystyle \mathbf{f}(\mathbf{v}) = \mathbf{f}\_1(\mathbf{v})\times\mathbf{f}\_2(\mathbf{v})}

 then

∂

f

∂

v

⋅

u

=

(

∂

f

1

∂

v

⋅

u

)

×

f

2

(

v

)

f

1

(

v

)
×

(

∂

f

2

∂

v

⋅

u

)

.

{\displaystyle
 \frac{\partial \mathbf{f}}{\partial \mathbf{v}}\cdot\mathbf{u} = \left(\frac{\partial \mathbf{f}\_1}{\partial \mathbf{v}}\cdot\mathbf{u}\right)\times\mathbf{f}\_2(\mathbf{v}) + \mathbf{f}\_1(\mathbf{v})\times\left(\frac{\partial \mathbf{f}\_2}{\partial \mathbf{v}}\cdot\mathbf{u} \right).
 }
3. If

f

(

v

# )

f

1

(

f

2

(

v

)
)

{\displaystyle \mathbf{f}(\mathbf{v}) = \mathbf{f}\_1(\mathbf{f}\_2(\mathbf{v}))}

 then

∂

f

∂

v

⋅

u

=

∂

f

1

∂

f

2

⋅

(

∂

f

2

∂

v

⋅

u

)

.

{\displaystyle
 \frac{\partial \mathbf{f}}{\partial \mathbf{v}}\cdot\mathbf{u} = \frac{\partial \mathbf{f}\_1}{\partial \mathbf{f}\_2}\cdot\left(\frac{\partial \mathbf{f}\_2}{\partial \mathbf{v}}\cdot\mathbf{u} \right).
 }

### Derivatives of scalar-valued functions of second-order tensors

Let

f
(

S

)

{\displaystyle f(\mathbf{S})}

 be a real-valued function of the second order tensor

S

{\displaystyle \mathbf{S}}

. Then the derivative of

f
(

S

)

{\displaystyle f(\mathbf{S})}

 with respect to

S

{\displaystyle \mathbf{S}}

 (or at

S

{\displaystyle \mathbf{S}}

) in the direction

T

{\displaystyle \mathbf T }

 is the  **second order tensor** defined as

∂
f

∂

S

:

T

=
D
f
(

S

)
[

T

# ]

[

d

d
α

f
(

S

α

T

)

]

# α
0

{\displaystyle
 \frac{\partial f}{\partial \mathbf{S}}:\mathbf{T} = Df(\mathbf{S})[\mathbf{T}]
 = \left[\frac{d }{d \alpha}~f(\mathbf{S} + \alpha\mathbf{T})\right]\_{\alpha = 0}
}

for all second order tensors

T

{\displaystyle \mathbf T }

.

*Properties:*

1. If

f
(

S

# )

f
1

(

S

)

f
2

(

S

)

{\displaystyle f(\mathbf{S}) = f\_1(\mathbf{S}) + f\_2(\mathbf{S})}

 then

∂
f

∂

S

:

T

=

(

∂

f
1

∂

S

∂

f
2

∂

S

)

:

T

.

{\displaystyle \frac{\partial f}{\partial \mathbf{S}}:\mathbf{T} = \left(\frac{\partial f\_1}{\partial \mathbf{S}} + \frac{\partial f\_2}{\partial \mathbf{S}}\right):\mathbf{T}.}
2. If

f
(

S

# )

f
1

(

S

)

f
2

(

S

)

{\displaystyle f(\mathbf{S}) = f\_1(\mathbf{S})~ f\_2(\mathbf{S})}

 then

∂
f

∂

S

:

T

=

(

∂

f
1

∂

S

:

T

)

f
2

(

S

)

f
1

(

S

)

(

∂

f
2

∂

S

:

T

)

.

{\displaystyle \frac{\partial f}{\partial \mathbf{S}}:\mathbf{T} = \left(\frac{\partial f\_1}{\partial \mathbf{S}}:\mathbf{T}\right)~f\_2(\mathbf{S}) + f\_1(\mathbf{S})~\left(\frac{\partial f\_2}{\partial \mathbf{S}}:\mathbf{T} \right).}
3. If

f
(

S

# )

f
1

(

f
2

(

S

)
)

{\displaystyle f(\mathbf{S}) = f\_1(f\_2(\mathbf{S}))}

 then

∂
f

∂

S

:

T

=

∂

f
1

∂

f
2

(

∂

f
2

∂

S

:

T

)

.

{\displaystyle \frac{\partial f}{\partial \mathbf{S}}:\mathbf{T} = \frac{\partial f\_1}{\partial f\_2}~\left(\frac{\partial f\_2}{\partial \mathbf{S}}:\mathbf{T} \right).}

### Derivatives of tensor-valued functions of second-order tensors

Let

F

(

S

)

{\displaystyle \mathbf{F}(\mathbf{S})}

 be a second order tensor-valued function of the second order tensor

S

{\displaystyle \mathbf{S}}

. Then the derivative of

F

(

S

)

{\displaystyle \mathbf{F}(\mathbf{S})}

 with respect to

S

{\displaystyle \mathbf{S}}

(or at

S

{\displaystyle \mathbf{S}}

) in the direction

T

{\displaystyle \mathbf T }

 is the  **fourth order tensor** defined as

∂

F

∂

S

:

T

=
D

F

(

S

)
[

T

# ]

[

d

d
α

F

(

S

α

T

)

]

# α
0

{\displaystyle
 \frac{\partial \mathbf{F}}{\partial \mathbf{S}}:\mathbf{T} = D\mathbf{F}(\mathbf{S})[\mathbf{T}]
 = \left[\frac{d }{d \alpha}~\mathbf{F}(\mathbf{S} + \alpha\mathbf{T})\right]\_{\alpha = 0}
}

for all second order tensors

T

{\displaystyle \mathbf T }

.

*Properties:*

1. If

F

(

S

# )

F

1

(

S

)

F

2

(

S

)

{\displaystyle \mathbf{F}(\mathbf{S}) = \mathbf{F}\_1(\mathbf{S}) + \mathbf{F}\_2(\mathbf{S})}

 then

∂

F

∂

S

:

T

=

(

∂

F

1

∂

S

∂

F

2

∂

S

)

:

T

.

{\displaystyle \frac{\partial \mathbf{F}}{\partial \mathbf{S}}:\mathbf{T} = \left(\frac{\partial \mathbf{F}\_1}{\partial \mathbf{S}} + \frac{\partial \mathbf{F}\_2}{\partial \mathbf{S}}\right):\mathbf{T}.}
2. If

F

(

S

# )

F

1

(

S

)
⋅

F

2

(

S

)

{\displaystyle \mathbf{F}(\mathbf{S}) = \mathbf{F}\_1(\mathbf{S})\cdot\mathbf{F}\_2(\mathbf{S})}

 then

∂

F

∂

S

:

T

=

(

∂

F

1

∂

S

:

T

)

⋅

F

2

(

S

)

F

1

(

S

)
⋅

(

∂

F

2

∂

S

:

T

)

.

{\displaystyle \frac{\partial \mathbf{F}}{\partial \mathbf{S}}:\mathbf{T} = \left(\frac{\partial \mathbf{F}\_1}{\partial \mathbf{S}}:\mathbf{T}\right)\cdot\mathbf{F}\_2(\mathbf{S}) + \mathbf{F}\_1(\mathbf{S})\cdot\left(\frac{\partial \mathbf{F}\_2}{\partial \mathbf{S}}:\mathbf{T} \right).}
3. If

F

(

S

# )

F

1

(

F

2

(

S

)
)

{\displaystyle \mathbf{F}(\mathbf{S}) = \mathbf{F}\_1(\mathbf{F}\_2(\mathbf{S}))}

 then

∂

F

∂

S

:

T

=

∂

F

1

∂

F

2

:

(

∂

F

2

∂

S

:

T

)

.

{\displaystyle \frac{\partial \mathbf{F}}{\partial \mathbf{S}}:\mathbf{T} = \frac{\partial \mathbf{F}\_1}{\partial \mathbf{F}\_2}:\left(\frac{\partial \mathbf{F}\_2}{\partial \mathbf{S}}:\mathbf{T} \right).}
4. If

f
(

S

# )

f
1

(

F

2

(

S

)
)

{\displaystyle f(\mathbf{S}) = f\_1(\mathbf{F}\_2(\mathbf{S}))}

 then

∂
f

∂

S

:

T

=

∂

f
1

∂

F

2

:

(

∂

F

2

∂

S

:

T

)

.

{\displaystyle \frac{\partial f}{\partial \mathbf{S}}:\mathbf{T} = \frac{\partial f\_1}{\partial \mathbf{F}\_2}:\left(\frac{\partial \mathbf{F}\_2}{\partial \mathbf{S}}:\mathbf{T} \right).}