This is a preprint. The published version is at
http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5445061&tag=1

Digital Human Faces

Direct-Manipulation Blendshapes
J.P. Lewis ■ Weta Digital
Ken Anjyo ■ OLM DigitalAnimators use blendshape facial models inanimation and film projects such as Stuart Little, Lord of Rings, and King Kong.
The blendshape technique is popular because it’sa simple linear representation that defines a semantic model of faces (see Figure 1). Unlike generic mesh-editing tools, blendshapes approximate
a space of valid facial expressions. Unlike linear
models constructed using principal component
analysis (PCA), the individual blendshape basis
shapes have clear, interpretable meanings.
To skillfully and efficiently use
a blendshape model, animators
Although direct manipulationmust memorize the function of
for figure animation has long
50 to 100 commonly used slidbeen possible using inverse
ers—and locating a desired slider
kinematics, there has been no
isn’t immediate (see Figure 2).
As a ballpark figure, professional
similar “inverse kinematics”
3D animation requires about one
approach for blendshapehour of labor to produce one secmodels. In both problems theond of animation. As in inverse
system must infer unknown
kinematics for figure animation,
degrees of freedom during
a direct-manipulation interface
each edit. We solve this
could significantly accelerate
problem by minimizing
this work. Although direct machanges in facial expression.
nipulation for figure animation
has existed for years, no existing
approach addresses directly manipulating blendshapes. (See the “Related Work in Facial Animation” sidebar for details on other approaches.)
Generally, interfaces should offer both direct
manipulation and editing of underlying parameters. Although direct manipulation usually is morenatural and efficient, parameter editing can be
more exact and reproducible, so animators might
prefer it in certain cases. Most professional graphics software provides both interaction modes. For
example, 2D compositing packages such as Shakelet animators position images by either dragging or
42

July/August 2010

adjusting translation values or animation curves.
Three-dimensional figure animation widely uses
direct manipulation by inverse kinematics. Forward kinematics is still used for some purposes,
however; for example, you can most easily mimic
the periodic flapping of a bird’s wing by animating
the appropriate joint angles. Additionally, taking
the forward-kinematics or parametric viewpoint
often is useful in operations such as filtering on aparticular parameter’s graph over time.1,2 Parameter editing has been the only possibility for blendshapes until now.
Here, we introduce a direct-manipulation approach for blendshapes. Because a realistic blendshape model can have 100 degrees of freedom(DOF) or more, direct manipulation requires inferring many parameters for each known DOF. We
regularize this inverse problem by exploiting the factthat facial-pose changes are proportional to slider
position changes. The resulting approach is simple
to implement, efficient (involving only linear systemsolvers), and compatible with existing blendshapemodels. Crucially, it also interoperates with the traditional parameter-based keyframe editing that current animation practices use. As we’ll show, a single
direct-manipulation edit is usually equivalent to anumber of edits using the underlying sliders.

Manipulators
Manipulators are user interface elements indicating
the desired location of a particular corresponding
vertex. Our implementation automatically createsa small sphere to represent each manipulator.
The selected manipulator (the active manipulator)
is the one being moved; the other manipulatorsserve as constraints. Because the manipulator locations are initialized from the locations of thecorresponding vertices, we sometimes use the twoterms interchangeably.

Published by the IEEE Computer Society

0272-1716/10/$26.00 © 2010 IEEE

(a)

(b)

(c)

(d)
Figure 1. Different facial-editing approaches. (a) Generic surface-editing tools aren’t suitable for facial
animation because they don’t respect the space of valid face shapes. (b) The 10th, 50th, and 100th
eigenvectors of a facial image collection. A principal component analysis (PCA) basis isn’t a semantic orhuman-editable representation; it’s difficult to know how much of these basis vectors to add to match aparticular face. (c) A PCA basis generated from a professional animation is similarly uninterpretable.
(d) Blendshape targets are suitable for human editing because they have clear, identifiable roles such as
RAISE-BROW, SMIRK, and JAW-OPEN (from left to right).

Figure 2. A portion of the blendshape slider interface for a professionally created model (the complete set of sliders doesn’t fit on
the computer display). The model has more than 100 sliders.
IEEE Computer Graphics and Applications

43

Digital Human Faces

Related Work in Facial AnimationT

he facial-animation and facial-editing literature covers
various approaches, but our article discusses only a few
representative facial-editing approaches. The “Blendshape
Facial Animation” sidebar briefly discusses such models’definition and history; another great general facial-animationreference is Computer Facial Animation.1
One possible approach is to edit face meshes withstandard geometric deformers such as free-form deformation lattices. Radial basis functions are an attractive editing approach because you can place the control points tocoincide with important locations such as the mouth andeye corners.2 Bernd Bickel and his colleagues propagated
the influence of marker points across the face mesh by minimizing energies defined by the iterated Laplace-Beltrami
operator on the mesh.3 Li Zhang and his colleagues usedradial basis functions to locally blend facial basis shapes.4
Wei-Wen Feng and his colleagues used kernel canonical correlation to identify a mapping between surface points and“bones” driving the skin movement and used regression to
generate the bone movement from the manipulators.5 Thissystem can generate plausible facial deformations from asparse, underdetermined set of control points.
Facial animation is a broad area; several other directmanipulation approaches for faces exist, including somethat involve linear models. For example, Manfred Lau andhis colleagues’ approach learned a prior on coefficients ofan underlying principal component analysis (PCA) modelusing the mixtures-of-factor-analyzers approach.6 The
direct-manipulation inverse problem can be considered instatistical terms as data imputation and can be solved withmethods such as PCA imputation.7 However, this requires
an iterative solution and degrades when the basis isn’t orthogonal. Other approaches have included facial manipulation through an underlying physical simulation.
Previous researchers often avoid the inverse problem
by driving the face mesh with a full set of manipulators(see Figure A1).2,3,8 This is appropriate for performancedriven facial animation, in which the positions of the fullset of markers are available. When a single manipulator
or marker moves, these approaches superficially resemble(1)

Figure A. A comparison of performance-driven facial movement with
our direct-manipulation approach: (1) Approaches that drive a facemodel with motion capture can be adapted for direct manipulation.
However, because the model is fully constrained, you must specify the
position of every vertex or motion capture marker. (2) Our approach
resembles inverse kinematics: it can constrain any desired subset ofvertices and automatically infer the remaining points’ positions.

the direct manipulation our system offers, with a crucial
difference. The equivalent in our system is to place a fullset of constraining pins on the face. However, our system
permits facial movement with any number of constraining
pins (including none), which permits larger, less constrained edits (see Figure A2).
The approaches closest to ours drive blendshapes withmotion-capture data; for example, one such approach
automatically determines localized blendshape regions.9
Such approaches provide direct manipulation as a side effectif they let users interactively move the individual markers’
positions. However, they fully constrain the facial motion,
limiting the power of individual edits (see Figure A1).
Unlike previous research, our approach targets manuallysculpted and semantically parameterized blendshape models common in current animation practice. It doesn’t requirea PCA basis or a custom model; it works with any existing
blendshape model. The approach reflects direct-manipulation
edits in the blendshape sliders’ positions and vice versa, so

MethodFigure 3 shows how our system (built using acommercial animation software package) operates. The animator simply selects control points
or vertices and drags them to desired locations.
Previously moved vertices act as constraints whensubsequent vertices move.3 Vertex configurations
that the system can’t reach from the blendshapesubspace are approximated.

Directly Manipulating a Given Model
As the animator selects and drags a particular vertex
44July/August 2010(2)

on the face model, the system must determine theother vertices’ positions. Our solution acknowledges
that a skilled artist created the blendshape modelthat inherently defines the character’s desired rangeof movement. This leads to two observations.
First, a face model with m vertices has potentially
3m DOF. However, if the face is a blendshape modelwith n targets, the face movement is restricted to a
subspace of dimension n. This is the space of valid
shapes as defined by the model’s creator; the directmanipulation solution should remain in this space.
Second, the space of valid shapes is adequately

the animator can switch between direct manipulation and blendshape parameter editing
as appropriate. This isn’t possible with other approaches, such as those relying on an underlying
PCA basis (see Figure 1 in the main article). Our
approach is simple to implement and involves
only a constrained linear-system solver.

(a)References
1. F.I. Parke and K. Waters, Computer Facial Animation,
AK Peters, 2008.
2. J. Noh, D. Fidaleo, and U. Neumann, “AnimatedDeforma­tions with Radial Basis Functions,” Proc.
ACM Symp. Virtual Reality Software and Technology(VRST 00), ACM Press, 2000, pp. 166–174.
3. B. Bickel et al., “Multi-scale Capture of Facial
Geometry and Motion,” ACM Trans. Graphics,
vol. 26, no. 3, 2007, p. 33.
4. L. Zhang et al., “Spacetime Faces: High Resolution
Capture for Modeling and Animation,” ACM Trans.
Graphics, vol. 23, no. 3, 2004, pp. 548–558.
5. W.-W. Feng, B.-U. Kim, and Y. Yu, “Real-Time
Data Driven Deformation Using Kernel CanonicalCorrelation Analysis,” ACM Trans. Graphics, vol.
27, no. 3, 2008, article 91.
6. M. Lau et al., “Face Poser: Interactive Modelingof 3D Facial Expressions Using Facial Priors,”
ACM Trans. Graphics, vol. 29, no. 1, 2009, pp.
1–17.
7. R. Dear, A Principle-Component Missing Data Method
for Multiple Regression Models, tech. report SP-86,
Systems Development Corp., 1959.
8. B. Choe, H. Lee, and H.-S. Ko, “Performance-Driven
Muscle-Based Facial Animation,” J. Visualization
and Computer Animation, vol. 12, no. 2, 2001,
pp. 67–79.
9. P. Joshi et al., “Learning Controls for Blend ShapeBased Realistic Facial Animation,” ACM Siggraph2006 Courses, ACM Press, 2006, article 17.

parameterized by the blendshape weights (sliders).
In turn, this implies that Euclidean distance inslider space is an approximation of the semantic
distance between face poses.
With these observations in mind, we can evaluate possible solutions to the direct-manipulation
problem. One would be to require all other vertices to move as little as possible. Although this has
some appeal, the animator’s goal isn’t to manipulate the face as little as possible—he or she would
rather take large steps, provided they’re predictable
and controllable.

(b)
Figure 3. Screenshots of our system in operation. (a) A blendshapemodel posed by direct manipulation rather than traditional slider
weight editing. (b) Control over a smile’s shape by direct manipulationof several vertices. The figures are screen captures of the Maya programinterface and are low resolution owing to hardware rendering.

Instead, we find the movement that causes thesmallest change in sliders, subject to interpolating
the active vertex. This solution embodies the second observation, that the sliders are an appropriate parameterization of the model.
Using Equation B in the “Blendshape Facial Animation” sidebar, we could achieve a direct implementation of this approach by solving
1
2
min w − w 0 + l T (m − Bw ),	
2 w

(1)

where w are the current blendshape weights, w0
are the previous weights, T denotes transpose, m isthe vector containing the moved manipulators, B
are the corresponding rows of the B matrix, andl is a Lagrange multiplier vector.
Although this approach works, we instead minimize the distance between the model and the
moved manipulator using least squares,
2

2

min Bw − m + a w − w 0 ,	w(2)rather than a hard constraint. (In our system, we
set the regularization parameter a to a small number such as 0.1.) We explain the motivation forusing Equation 2 rather than Equation 1 in thenext two sections.

Pinning
After the animator drags a vertex, it is desirable
IEEE Computer Graphics and Applications

45

Digital Human Faces

Blendshape Facial AnimationA

blendshape model is a linear weighted sum of a number of blendshape “targets,” which typically represent
individual facial expressions (such as a smile or frown) or
shapes based on approximations of facial-muscle actions
or FACS (Facial Action Coding System) motions.1,2 To simplify notation, we represent the face model as a column
vector f containing all the model vertex coordinates insome arbitrary but fixed order, such as xyzxyzxyz. Similarly,
we denote the blendshape targets as vectors bk, so theblendshape model isf=∑ w b .	
k

k

(A)

k

The carefully sculpted blendshape targets serve as interpretable controls; the span of these targets strictly defines
the valid range of expressions for the modeled face (in practice, not all combinations produce equally plausible results).
These characteristics differentiate the blendshape approachfrom those that involve linear combinations of uninterpretable shapes or algorithmically recombine the target shapes
using a method other than that in Equation A.
We can place the blendshape targets in columns of a matrix B and gather the weights (also called blendshape sliders)in a vector w so that the blendshape model can be denoted as
f = Bw.	(B)

The model’s geometric resolution (one-third of B’s row
dimension) is independent of the animation resolution(the number of blendshape targets, or B’s column dimension). For example, a model with low geometric resolution
nevertheless might have many targets, resulting in a richspace of deformations. In our system, any subset of vertex
components (corresponding to particular rows of f) can
be constraints, and direct manipulation occurs in these
constraints’ null space.
A well-known early animation popularized the blendshape approach,3 and commercial animation packages
were incorporating the approach by the late 1980s. The
approach isn’t associated with any single publication,
however, and it received scant attention from researchers until the publication of papers by Frederic Pighin andhis colleagues 4 and Pushkar Joshi and his colleagues. 5
Most research has focused on the problems of constructing a high-quality blendshape model from data,4 driving
blendshape models from motion-capture data,6 or finding
an automatic segmentation into independent, localized
blendshape regions.5

Early on, animators debated the relative advantagesof whole-face and delta blendshapes. In the whole-facescheme, each column of B represents an entire facial expression, such as a smile. In the delta form, the targets areoffsets from a neutral face f0 that’s added as f = Bw + f0, somany entries in each target vector are zero or nearly zero. In
both cases, the weights are usually nonnegative (and reflecta convex combination of the basis shapes in the nondeltaform)—although allowing mildly negative weights is occasionally useful. The whole-face approach makes it easierto reproduce the chosen expressions and can be efficientfor modeling speech if the basis includes a set of visemes.
On the other hand, this approach makes controlling local
adjustments more difficult. Current industry practice mostoften uses delta blendshapes modeled on facial muscles.
Principal-component models resemble blendshapemodels in that they’re also a linear sum of basis vectors. However, unlike blendshapes, principal-component
models are orthogonal, and the individual basis vectors
generally lack semantic interpretations.7 Humans cansometimes interpret the first couple of principal components. However, the remaining components are incoherent and do not have clear semantic interpretations such as
RAISE-BROW. (see the upper and middle rows in Figure 1
in the main article). It is difficult to estimate how much of
a component to add to produce some desired expression.
Another difference is that the PCA model’s weights are
zero-mean, not nonnegative.

References
1. P. Ekman and W. Friesen, Manual for Facial Action Coding
System, Consulting Psychologists Press, 1978.
2. M. Sagar, “Facial Performance Capture and Expressive Translation
for King Kong,” Siggraph Sketches, ACM Press, 2006, article 26.
3. P. Bergeron and P. Lachapelle, “Controlling Facial Expression
and Body Movements in the Computer-Generated Short‘Tony de Peltrie,’” Siggraph Tutorial Notes, ACM Press, 1985.
4. F. Pighin et al., “Synthesizing Realistic Facial Expressions from
Photographs,” Proc. Siggraph, ACM Press, 1998, pp. 75–84.
5. P. Joshi et al., “Learning Controls for Blend Shape BasedRealistic Facial Animation,” ACM Siggraph 2006 Courses,
ACM Press, 2006, article 17.
6. B. Choe, H. Lee, and H.-S. Ko, “Performance-Driven MuscleBased Facial Animation,” J. Visualization and Computer Animation,
vol. 12, no. 2, 2001, pp. 67–79.
7. D. Lee and H.S. Seung, “Learning the Parts of Objects by
Non-negative Matrix Factorization,” Nature, vol. 401, no.
6755, 1999, pp. 788–791.

to “pin” that vertex, forcing it to remain stationary as he or she drags and pins other vertices.3
We easily accomplish this by simply appending the46

July/August 2010

pinned vertices to m and the corresponding rows
to B (see Equation 2). So, the implementation
doesn’t distinguish between dragged and pinned

60

vertices; both are simply constraints. Each pinned
vertex adds three rows to B and m, but partiallyconstraining a vertex is straightforward—for example, by including only the rows corresponding
to the x and y dimensions.
In a particularly simple model, it’s possible (butunlikely) that when a sufficient number of vertices are constrained, B will become full rank.
In this case, the right-hand term in Equation 1
would fully constrain the facial movement. Moregenerally, Equation 1 permits movement only inthe constrained vertices’ null space.
However, in practice, some additional directions are “almost” in the null space, corresponding to singular values that are almost but not quite
zero (see Figure 4). Equation 2 allows movementin these directions, providing additional freedom
with only a slight violation of the constraints. We
obtain this flexibility at the expense of treating themanipulators as soft rather than hard constraints(we consider this a useful, natural trade-off). If
needed, we can easily obtain more precise control
over particular manipulators’ influence by incorporating weights on each manipulator and solving
Equation 2 using weighted least squares.

Haphazard Movements
An animator could drag vertices in directions andto extents that the model can’t reasonably accommodate (see Figure 5). Blendshapes controlled bya standard slider interface have a similar problem(the animator can drag the sliders too far). This
isn’t a problem for experienced animators. However, we also cope with the problem by constraining the sliders to a range [0, t] with t set to 1.
Additionally, we incorporate a mild weight decay
2
regularization term m w , with m = 0.001. We
can understand this term’s rationale by imagining

(a)

50
40
30
20
10
0
0

1

2

3

4

5

6

7

8

9

Figure 4. The first 10 singular values of theblendshape basis of the model in Figure 5. (Smallsingular values correspond to weight directions thathave little effect on the model.) Although the basis
has full rank, many directions “almost” define a nullspace.

a manipulator that repeatedly moves from one location to another and back again. In this scenario,
after extensive manipulation, components of w in
the null space of B can grow owing simply to numerical error. The weight decay regularization opposes this possibility and biases the results awayfrom extreme poses.
Putting these together, the general form of our
objective is2

min Bw − m + α w − w 0w

22+ µ w ,	

(3)subject to w ∈ [0, t], giving the corresponding quadratic program:
min
w

1 T
w Sw + q T w
2subject to Gw ≺ h(b)

Figure 5. Dealing with haphazard animator movements. (a) Model behavior with unconstrained weights as
the animator drags the active manipulator to an unreasonable location. The green sphere is the animator’s
desired active-manipulator location. (b) The corresponding constrained solutions to this haphazard drag.
IEEE Computer Graphics and Applications

47

Digital Human Faces

Producing such an expression using traditionalslider editing would typically require several iterations of weight adjustment, as well as trial anderror. Figure 3b shows how direct manipulation cancontrol a cartoon character’s smile. A companion
video (available at http://scribblethink.org) shows
additional examples of interactive direct manipulation of standard blendshape models.

(a)Direct Manipulation versus Parametric Control(b)
Figure 6. The relationship between direct movements
and slider movements. (a) Direct movement of a single
vertex creates (b) many subtle slider movements.
However, the converse is also true: a single slider
movement in some cases equals multiple direct
manipulations. Both approaches are desirable.

In facial animation, we can illustrate the benefits
of offering both direct manipulation and indirect
parameter control in terms of the effort requiredfor different facial edits. As we mentioned before,a single direct-manipulation vertex move generally
equals many slider movements.
To see this mathematically, consider solving
Equation 2 for the weights−1with S = 2 (B B + (α + µ) I)T

q = −2BT m + a w 0T

G = [I; −I]

h = [ t1n ; 0 n ] ,where I is the identity matrix and 0 n and 1n are
zero- and one-vectors of length n. Because the matrix S is m × m (with m ≈ 100), we easily solve thisat interactive rates on current machines. Figure 5
shows the results of Equation 3 versus Equation 2
on an unreasonable movement.

Implementation Assumptions
Our work targets professional animators rather
than novice users. Current animation practice
employs large software packages such as Maya thathave reusable components implementing most of
our needed functionality, including basic blendshapes, spline surfaces, constraining of points tosurfaces, and interaction in a perspective window.
We further assume that the animator is skilled inthis software. In particular, in the case of spline
models we provide direct manipulation of the
spline control vertices. This is standard practice inmanipulating spline surfaces and not a challenge
for skilled animators.

Results
Direct-manipulation editing is a familiar concept
and presents few surprises. Figure 3a shows a blendshape model posed by our direct manipulation atinteractive rates, using three constraints (“moves”).
July/August 2010

(BT m + aw 0 ) .

This equation is of the formw = Xm + k,	

(4)
−1

T

48

w = (BT B + aI)

with X = (BT B + aI) BT . Consider the effect ofm containing a single pinned vertex. The X matrix
is denser than B owing to the convolution effectof the matrix multiplication and the bandwidth
increase due to the matrix inverse. So, the directmanipulation move will produce many nonzero
weights (see Figure 6).
Although it might seem contradictory, the converse is also true: a single slider movement canequal multiple direct manipulations. We can analyze the situation by consideringm = Bw .
With the weight change regularization min w − w 0
in Equation 2, columns of B corresponding to unaltered sliders have little effect. We can imagine
the system containing only columns corresponding to the altered sliders in w. In this case, theconstraints provided by a single pinned 3D vertex provide information to solve up to three unknowns in w. However, the vertex corresponding tom might be nonzero in a number of blendshapes.
If more than three blendshape targets affect thevertex, a full specification of the state of the face
will require additional directly manipulated vertices. For example, if the animator has moved six
sliders, obtaining the equivalent facial shape withdirect manipulation will require pinning at least
two vertices.

So, both direct manipulation and slider control
are advantageous in different circumstances, andboth should be provided. Slider control is more
effective when the desired action directly corresponds to a particular slider’s effect or when theedits must be reproducible and numerically accurate. On the other hand, direct manipulation
is more intuitive and generally more powerful,
because of the matrix’s action in Equation 4 andbecause each direct-manipulation edit specifies
several DOF.

(a)

(b)

(c)

(d)

Unifying Whole-Expression andDelta Blendshape Views
As we discuss in the “Blendshape Facial Animation” sidebar, using blendshape targets that represent complete expressions, such as a viseme or asmile, can save time over recreating an expression
from muscle-based targets each time we requireit. On the other hand, it’s difficult to make exact, local adjustments by blending a set of targets
with global influence. As a result, many animators
avoid whole-expression blendshapes when subtle,
local control is required.
Our technique lets us easily combine localized
adjustments with whole-expression control. The
animator first creates any desired set of wholeexpression blendshapes. Then, the system saves theweight vectors expressing these shapes in terms of
the original local blendshape targets.
The animator can blend these expressions as desired. Internally, the result is a new weight vector
that’s itself a weighted sum of the we vectors. To
allow localized adjustment, we simply use this vector in the role of w0 in Equation 3. In other words,
direct manipulation will now stay as close as possible to the previously edited whole expression
while respecting the desired local edit (see Figure 7). The we specifications of whole-expression
blendshape targets can optionally include only asubset of sliders. For example, one could specify aviseme library using only the sliders affecting themouth region.

Animator Feedback
Comments from professional animators havebeen generally positive. One animator said thatthe direct-manipulation capability resembles clusters, but with the advantage of working within thespace of the blendshape targets. (Clusters are aweighted fall-off skin deformation technique thatlets animators directly move surface vertices.)
Another comment was that the technique is advantageous when you’re adjusting animations that
another animator created. This is a common situ-

Figure 7. Using direct manipulation to make local adjustments on wholeface expressions. The whole-face (a) “ah” and (b) “oo” visemes createdin advance. (c) A weighted combination of these two expressions.
(d) The result of local direct manipulation.

ation owing to the increasing use of motion capture in movies such as Beowulf and Avatar. In theseprojects, animators animate the nonhumanoid
characters, but they also make small alterations to
the original actors’ performances due to needs that
become apparent only after the motion is captured.
To understand the animator’s comment, remember that producing original facial animationis laborious. Over the course of days and weeks,
the animator forms a strong memory of boththe model and the logic of the slider movements
used to create the animation. Animators are also
trained to prefer a particular logic and disciplineof slider movements—for example, some animators
always move sliders corresponding to particularmajor muscles first. When animators must adjustan animation they didn’t create, however, they
don’t have any memory of the slider combinations
that created particular movements. In this situation, adjusting the model using only sliders caninvolve much trial and error.
Negative comments focused on aspects of our admittedly prototypical software implementation. For
example, when animators drag direct-manipulationpins, the corresponding sliders don’t update until
they release the mouse. However, this is simply aIEEE Computer Graphics and Applications

49

Digital Human Faces

limitation of our current implementation rather
than of the method itself.

I

nitial feedback confirms that animators regard
our direct-manipulation framework as naturaland obvious, and we believe it will become a practical, effective technique. The direct-manipulation
problem’s underconstrained nature could also permit future extensions using a statistical prior on
the facial expression. Similar statistically based approaches have proved successful in other face-editing
research as well as style-based inverse-kinematics
animation of the body.

Acknowledgments
Hiroki Itokazu, Tatsuo Yotsukura, Ng Jiahao, Nickson
Fong and Egg Story Creative Productions, Dejan Momcilovic, Kyle Labad, Raymond Chan, and Gray Hodgkinson provided models and animation data. We thankYosuke Katsura, Ayumi Kimura, Luca Fascione, Nebojsa Dragosavac, Andy Jones, Ben Forster, Pravin Bhat,
James Jacobs, Sebastian Sylwan, and Joe Letteri for
discussions and help. The Japan Science and Technology Agency’s Core Research of Evolutional Science andTechnology project partially supported this research.

References
1. M. Unuma, K. Anjyo, and R. Takeuchi, “Fourier
Principles for Emotion-Based Human Figure Anima­tion,” Proc. Siggraph, ACM Press, 1995, pp. 91–96.
2. A. Bruderlin and L. Williams, “Motion Signal
Processing,” Proc. Siggraph, ACM Press, 1995, pp.
97–104.
3. K. Yamane and Y. Nakamura, “Natural Motion
Animation through Constraining and Deconstraining
at Will,” IEEE Trans. Visualization and Computer
Graphics, vol. 9, no. 3, 2003, pp. 352–360.

J.P. Lewis is a member of Weta Digital’s researchgroup and a senior lecturer at Victoria University in
New Zealand. His research interests include facial
animation and computer vision. Lewis has publishedmore than 40 papers on a variety of topics and has
several patents and film credits. Contact him at zilla@computer.org.
Ken Anjyo is the digital-effects and R&D supervisor
at OLM Digital and an affiliate professor at Kyushu
University. His research focus is on the constructionof mathematical and computationally tractable models
for computer graphics. Anjyo has a PhD in information engineering from Nagoya University. Contact
him at anjyo@acm.org.

EXECUTIVE STAFFPURPOSE: The IEEE Computer Society is the world’s largest associationof computing professionals and is the leading provider of technicalinformation in the field.
MEMBERSHIP: Members receive the monthly magazine Computer,discounts, and opportunities to serve (all activities are led by volunteer
members). Membership is open to all IEEE members, affiliate society
members, and others interested in the computer field.
COMPUTER SOCIETY WEB SITE: www.computer.org
OMBUDSMAN: Email help@computer.org.
Next Board Meeting: 11 June 2010, Denver, CO, USA

EXECUTIVE COMMITTEE
President: James D. Isaak*
President-Elect: Sorel Reisman;* Past President: Susan K. (Kathy) Land,
CSDP;* VP, Standards Activities: Roger U. Fujii (1st VP);* Secretary:Jeffrey M. Voas (2nd VP);* VP, Educational Activities: Elizabeth L. Burd;*
VP, Member & Geographic Activities: Sattupathu V. Sankaran;† VP,
Publications: David Alan Grier;* VP, Professional Activities: James
W. Moore;* VP, Technical & Conference Activities: John W. Walz;*
Treasurer: Frank E. Ferrante;* 2010–2011 IEEE Division V Director:
Michael R. Williams;† 2009–2010 IEEE Division VIII Director: Stephen
L. Diamond;† 2010 IEEE Division VIII Director-Elect: Susan K. (Kathy)
Land, CSDP;* Computer Editor in Chief: Carl K. Chang†*voting member of the Board of Governors†nonvoting member of the Board of Governors

BOARD OF GOVERNORS
Term Expiring 2010: Piere Bourque; André Ivanov; Phillip A. Laplante;
Itaru Mimura; Jon G. Rokne; Christina M. Schober; Ann E.K. Sobel
Term Expiring 2011: Elisa Bertino, George V. Cybenko, Ann DeMarle,
David S. Ebert, David A. Grier, Hironori Kasahara, Steven L. Tanimoto
Term Expiring 2012: Elizabeth L. Burd, Thomas M. Conte, Frank E.
Ferrante, Jean-Luc Gaudiot, Luis Kun, James W. Moore, John W. Walz

50

July/August 2010

Executive Director: Angela R. Burgess; Associate Executive Director;
Director, Governance: Anne Marie Kelly; Director, Finance &Accounting: John Miller; Director, Information Technology & Services:
Carl Scott; Director, Membership Development: Violet S. Doan;
Director, Products & Services: Evan Butterfield; Director, Sales &Marketing: Dick PriceCOMPUTER SOCIETY OFFICES
Washington, D.C.: 2001 L St., Ste. 700, Washington, D.C. 20036
Phone: +1 202 371 0101; Fax: +1 202 728 9614; Email: hq.ofc@computer.org
Los Alamitos: 10662 Los Vaqueros Circle, Los Alamitos, CA 90720-1314
Phone: +1 714 821 8380; Email: help@computer.org
Membership & Publication Orders:
Phone: +1 800 272 6657; Fax: +1 714 821 4641; Email: help@computer.org
Asia/Pacific: Watanabe Building, 1-4-2 Minami-Aoyama, Minato-ku, Tokyo
107-0062, Japan
Phone: +81 3 3408 3118 • Fax: +81 3 3408 3553
Email: tokyo.ofc@computer.org

IEEE OFFICERS
President: Pedro A. Ray; President-Elect: Moshe Kam; Past President:
John R. Vig; Secretary: David G. Green; Treasurer: Peter W. Staecker;
President, Standards Association Board of Governors: ; W. Charlston
Adams; VP, Educational Activities: Tariq S. Durrani; VP, Membership& Geographic Activities: Barry L. Shoop; VP, Publication Services &Products: Jon G. Rokne; VP, Technical Activities: Roger D. Pollard; IEEE
Division V Director: Michael R. Williams; IEEE Division VIII Director:
Stephen L. Diamond; President, IEEE-USA: Evelyn H. Hirt

revised 20 Jan. 2010