- 0 1 e:-0bD-0:

1:8

2

8233
E2anr9EE2W4Ei••••••*+) !,$?
-)"1+8:>7#' '%"8:>7 #'%"42<>=3;67(',$?
5967*'-,#. *-,$?
0 / &'-,#.
8:>7#' #'-,#.

2)%'$(1)*
Copyright: All Rights Reserved

Copyleft: All Rights Reversed"1)*35,70!
&#;+-4 !2*:.
! / 8
96:. 3

DE#$ !
 "     $

'%$& & "!&#…

4       %&$'"'(2018* -  )4 +5=9>;!3*-4 
16+5:0!
+5/.7<%
 >,82
#


http://www.complexityandevaluation.com.au

5

FK3K>MPK>MP;N7JT=AG8PU
J :@RHPIF;AO3
&$!$,-0$" )#*',$--')%-* 1!$2TV9OWLJDH<XK (.$ +!($/ (. -'*)F S 87GCE6Q5K3 ?Q :PH9CAJFW
IB=F?46――”――“7HIV/AIDS

“――“”

――
“7( )%#+-$ .&( ,)((+"%+'2031/ #* !.)
8



Getting to Maybe



9
Frances Westley
Brenda Zimmerman
and Michael Quinn Patton
10 11



6a )r Op{En•qK;|•" )r>diu0^~s'9_•❚ 8q SFtIk_VBT@zu'9_•'dirt.qRsU"q SFo_%Ip{EnuBTrtq_Vs{\ya[a Mtq[•❚ _}bu2wx
f _6b•SFt$Amco{Z_Vgvnsp{r*ot^`~q[❚(Gs_Zu2}[C, i•❚_/❚ tN_|ln{\ya[a}\r-M4#_%I • s'+t2
%h•C,s?&_U[DLtXN_<]s^YH3•7 2008!Vp.30)}

qK;tQ =re^$rAjq[^P,p{t5sV
oen:Jeqbuq~
q[WC,s?&_1

12+#'<,• P (Q• KGMNJOP 1.Q• )"P!> &1.Q
 @7?
'<

=?
1-C*%=B89
6EF 5D
3;1:2DF
2AB/;5D3;?
:*F
HILO;49
0D3;1
$:2<#'<13)

14


IMPACTOUTCOMESOUTPUTSACTIVITIESINPUTSTime
Inspired by Jeff Conklin,
15
cognexus.org

   16

O     …
OUTPUT

U
TC
O

M

E

ME
O
C
T
OU

OUTCOMEOUTPUT

ACTIVITYOUTPUT

ACTIVITYOUTCOMEINPUTS
ACTIVITYINPUTSOUTPUT

ACTIVITYOUTCOM

E

CO
OUT

OU
TC
OM

MEEOUTPUTTime

INPUTSINPUTS17

…
OUTPUTCOM
OUT

OUTCOMEOUTPUT

ACTIVITYOUTPUTOUTCOMEINPUTS
ACTIVITYINPUTS

O

U
TC
O

M

E

E

OUTPUT

ACTIVITYACTIVITY

OUTCOM

E

COM
T
U
O

OU
TCOM

E

E

OUTPUTINPUTSINPUTS18(#  &"#$!



• 2B758.>
0/2B6HDF'
%%
• CA:9@=84 0/• $ ",;G3• ) '• IJ<E81?
• +!&-%"• * '19••••"'7<9301.2#!

6) -+4+ (&; 3% +,48*   /:5$

20

https://santafe.edu/21  22    



23

 

 





 

24

 



https://oxfamblogs.org/fp2p/how-to-plan-when-you-dont-know-what-is-goingto-happen-redesigning-aid-for-complex-systems/

25









TWP: Thinking andWorking Politically
THINKING AND WORKING POLITICALLY
THROUGH APPLIED POLITICAL ECONOMY ANALYSIS

DDD: DoingDevelopment Differently

A GUIDE FOR PRACTITIONERSCenter of Excellence on Democracy, Human Rights andGovernance26

TWP••••I&<*J%2,%'!',%'0-/9@J4?58B:63 < AG ?5D ;5J4 
EC=9TWP".*$& J4 () =9 2,%'7H!',%'0-/FL J;• "! -8F(• # 3$0.A,5F(• G'2D
+4F(• ?= 1- TWP   6BC• )E7/9K/
A1- :> @H

TWPI&TWP<*J;•Duncan Green, From Poverty to Power +1#11/27/2018I>KM
https://oxfamblogs.org/fp2p/thinking-and-working-politically-why-the-unexpected-success/(2019327)(m>qn~y{h kh{eMKN91 }qv&
i~ :zo~o~~hf• #;|g• -ne/0+~'• 5?4q{4t• ~m q~m¡
• 3.?6j qeuzh{8q i% }i• *~<2=e<$, 
I_YRQY@K\TTYA@LZa@HWQYVT@LQ[[TY]A@FDEGA@NbUZ\S@PYX`T\]X^c@O\T]]A@[[CFDBFFC¡
d!"MKN9}IJ72r
i~1 xzzgfwlpueMKN9}jesmIJ72 }~wf28

SYSTEMIC EVALUATION DESIGNA WORKBOOKBOB WILLIAMS29

201811American Evaluation Association    
Jonathan Morell, Applying Complexity to Make Practical Decisions About Program Theory,
30
Methodology, Data, and Stakeholder EngagementvjXÄ(bÃ§Ñ   £CG}¿Å¥¦À{µÏ³¨­¢²ÕÂCG}¢x¹²À§ÐÈ·Õ£¥Ç®´Í©¸¯¦À~É£ ¢¥¦À¨©¬ÏÃÅ¢fÄQÂÄº­¢0'ÌNy/ÄK5Ã9Ò¾¨Ñd¹»ÃÀ¼¾Å¢°¼²©$8Ä§ÑQº£  Ä/­W-ÃWÒ¾¨ÑFËÂ Å¢×ñÞóäßâÄÛ×âÄíñÚÄBÌhUÄ]_æì×âÄBºÓ©£Á»ÏË¢MÃíñÚÌæì×âBÔn®¢mÃÛ×âÌhUÄBÔn¯£ Ä:3/Ë¢¬ÂÐ  Ã¨/ElÔ>¯£% ØßÚÝæÖéÄ1ÄïèóâÃÎÒÆ¢[¿\ucÂâßç ­¢¬ÏÈ¿Ä ÄZÄ zÀ!´Ô<³¾¨ÑÀ¨©£¨½oª¾Ë­ÚìÚì³¾³È©
B*ÂÄº­¢ÚìÚìÅqÃn¨¾«¨¾¢²Ä/ÔoªÎ©ÀµÑÀ¢¨¬Ã0'­7#ÄÂ¨=L¬­8´ÒÑÅ¶º£
ÜëãóÃÎÒÆ¢²ÄÎ©Â   /Ä+&Å¢d¹»Ä| Ä?Ô¨ÓÕÂ7#¿w³¾³È©À¨©£ªÆ¢§Ñ HA@J¿¢g)Ä¹ÊÄ JaJÔt©ÀµÑ£¸²¿>¬ÒÑðÜßÚòêáîÅ¢a¡ O­g)Ã½¨¾Ä`Ô3Ñ¡-µÑ¡g­)µÑ¡ OÄYRPV­"µÑ¡ H ÄYRPV­"µÑ¢À¨¼¹ËÄÃÂÑºÓ©£²²È¿Ås¨­¢ÀÜëãóÅ ÄÎ©Ã;±¬°Ñ£¥²ÄðÜßÚòêáîÃÅ¢JÄIÅ§Ñ0'Ô4Ã¢º¨¹¨'iÃt®SÑÀ¨©DÄ6,­§Ñ£¤Ä OÄpÌaÄ.iÃÎ¼¾¢g"ÃÅ§Ñe2ÄåìàÙ­xÏÒÑ²ÀÅT¿®Ñ£¹º³¢JIÅ¸ÒÂÐÃrÃt®SÑºÓ©¢À¨©6,º£À²Ó­¢²Ä6,ÅN³¨ÄºÓ©¬£ª¾¢gÄ)­YRPVÄ"Ã^kµÑÀ¨©ðÜßÚ­§Ñ­¢¸ÒÅN³¨ÄºÓ©¬¦"!



Power Law




31



https://oxfamblogs.org/fp2p/how-to-plan-when-you-dont-know-what-is-goingto-happen-redesigning-aid-for-complex-systems/

32






#evalcomplexity2018

Places to intervene
PolicyPractices

Relationships &connections

PowerDynamics

MentalModel

Resource
Flows

StructuralchangevisibleSemi-visible

Transformativechangeinvisible

33

How do wemanageattribution
to/win/incollective
impact?

34

35

CS

C
8O

Ca fork in the road
CCC
DE

1

S

DE

9

“What is it that you don’t know that if you did know would make a difference towhat you do?”M?
https://youtu.be/wAryCSZI6Cw

•}|y z|{hmR~/h"l0 w$`cp)_vgWuS• T%cemRbvnhllqtwYu+k1svc
ZRbvm kRbvnhl.lqtwYu+kp1svu^idfcS`W-'w;<lxh(aui[Rb^hosvgWu.mR kosvc!hw!u.hmj\R%ceqZ k*ucj2&w#,aulw ]g\vurXj.dfclhVuU• DMMJL:55PPP4?IFFA?MEOAEGJ=?MBIKNG4IKC5>FICL5697865@AOAFIJGAHM=F3AO=FN=MEIH3?IHMAQM3?IFFA?MEOA3EGJ=?M3J=KM36

37

 ApproachStakeholder Assessment

General Elimination
MethodTheory BasedCounterfactual
Scenarios

Journalist

Detective

Scientist

Scenario BuilderUNIQUE
METHODS

Outcome Harvesting, Most
Significant Change/Instance

Process Tracing

Theory of Change

Rapid Impact
Evaluation

STRENGTHS

Easy to understand; canhandle a lot of outcomes;
flexibility in approach.

Thorough process thatis culturally credible inwestern cultures.

Works well withexisting theories ofchange; designed totackle ‘complex’ causalpackages.

Very useful when agroup faced withdifferent strategies.

LIMITATIONS

Sensitive to stakeholder
biases; not thorough inaddressing other factors.

Can take a long time tocomplete.

Can take a long time tocomplete; approachstill in developmentwith some unclearsteps.

Important to follow
model with highfidelity; may not
perceived as credible
by external people.

EXPERTISE

Modest expertise required;effort varies.

Specialist skills in GEM
and process tracing
required.

Strong facilitation skills; Requires multiple types
wide range ofof ‘content’ expertise.
evaluation skills.

EVALUATOR ROLE

38



#evalcomplexity201839 

CONCEPTUALISING COLLABORATIONCHAT.CSI.EDU.AU

Shared goal
Systemschange as apurpose

Adaptivecapacity

Process

SharedresourcesCollaboratio
nStructure

Sharedauthority

SharedaccountabilityCommunicat
ion flows
Wholesystemengagement40

!'#       
 &   $%"(41(!-/61   

%'+
"'+
73 
05 $)+$*,.
24#&  


42
   43

 +
ê #3#'=4&</;,":%+
5?AB@ 320 >4-8'/!$%
1#',":%+ 5>(9 6 C71-063D> ')
3D4."*;1 >81

C71-06

C%54-.$D45

The world commands us. We do not command it. And yet – ityields. So ”maybe” becomes a potent word for the brave, theinventive, the adventurous (p. xiv) 46      47

48 • ./A4CD 1E7:!))&(+++(%$#%' "$)'*"+• A0J6J@;1<E>G:.57/K  H2 @B3 =5I>1E8A=,?2937F@-49

n SMSMISSMSn luivv

G
CaOuDnve
uEvS
P ilt

Nu mpv
t

ilt

aOvt

 uDniltv/aOilttno50

  