RESTRICTEDWORLD TRADE
ORGANIZATIONWT/COMTD/W/73
21 June 2000
(00-2494)
Committee on Trade and Development
Twenty-Ninth Session
FRAMEWORK FOR MONITORING AND EVALUATING WTO
TECHNICAL COOPERATION
Note by the Secretariat
Table of Contents
Page
INTRODUCT ION................................................................................................................... ...........2
1. Aim of monitoring and evaluation.......................................................................................2
2. Scope of the evaluation process ...........................................................................................3
3. Dimensions of the evalua tion and WTO mission ...............................................................3
4. Monitoring mechanisms and types of evaluation...............................................................5
5. Planning and conduct of an evaluation...............................................................................6
6. Identification of indicators................................................................................................. ..6
7. Rating system ................................................................................................................ ........7
8. Preparation of reports ....................................................................................................... ...8
9. Use of conclusions and recommendations...........................................................................8
10. Lessons to be learned....................................................................................................... .....8
ANNEX I     - LOGI CAL FRAMEW ORK ..................................................................................10
ANNEX II   - BASIC FORMAT AND BROAD OUTLINES OF AN
EVALUATION REPORT .....................................................................................15
ANNEX III  - EVALUATION QUESTIONNAI RES..................................................................16WT/COMTD/W/73
Page 2
INTRODUCTION
The Guidelines and Modalities for implementing WTO technical cooperation envisage policy
and management tools designed for that purpose.  In essence, these comprise the Three-Year Plan
adjusted on an annual basis, the annual Secretariat Report on technical cooperation programme
implementation and ad hoc Secretariat status reports.
The guidelines (document WT/COMTD/8) furt her envisage that the monitoring and
evaluation will be carried out by the Committee on Trade and Development (CTD) on the basis of an
annual evaluation of the results of technical assistance activities with a view to ensuring optimum use
of resources in line with appropriate evaluation criteria. The implementation modalities
(WT/COMTD/ W/29/Rev.1) also provide for the possibility of an external evaluation of technical
cooperation activities.
In March 1999 the Secretariat prepared a note setting out the activities it had undertaken in
the first phase of the monitoring and evaluation process mandated by the CTD.  The note is contained
in document WT/COMTD/W/58/Rev.1 and was submitted to the CTD at its June 1999 meeting.
To further this exercise and to attain its set ob jectives, the Secretariat has outlined below, for
the benefit of the CTD, a proposal that could b ecome the "framework and guidelines" for monitoring
and evaluating WTO technical cooperation.
1. Aim of monitoring and evaluation
Monitoring and evaluation are two separate yet complementary management functions that
make it possible to ascertain whether technical cooperation activities are meeting their objectives.
They are intended to assess performance and the re sults of the activities in question in relation to
expectations.  They should go hand-in-hand with the implementation of technical cooperation
programmes with a view to identifying their potential problems and successes so that any necessarycorrective measures may be taken.
By objectively assessing successes and failures, the monitoring and evaluation process will
help to improve the future design and implementation of technical cooperation activities.  It will also
help to enhance the content of such activities on the basis of feedback and experience and to optimize
the use of resources.
This exercise should cover the following elements:
(a) WTO technical cooperation must adequately meet the real needs and expectations of
recipients.  To that end, monitoring and evaluation must make it possible to:
- Ascertain whether the activities were conceived and formulated in such a way as
adequately to attain their overall objectives.  The process of analysing requests from
beneficiaries and the corresponding replies should be meticulously evaluated.
- Pinpoint the factors hampering or favouring the attainment of the objectives set for
WTO technical cooperation.
(b) WTO technical cooperation activities should appropriately and consistently attain their
established goals and objectives.  This requires:
- Examining the quality of the support material.WT/COMTD/W/73
Page 3
- Assessing the process for identifying products (activities) by means of evaluative
tools that make it possible to gauge performance in relation to expectations.
- Assessing the capacity of the teams supplyin g the inputs needed for the activities and
determining the extent to which those inputs can be transformed into products orresults.
- Examining the results and impact of technical cooperation, taking account of the
opinions of beneficiaries, donors and regional and international WTO partner
institutions.
- Assessing the degree of real and potential sustainability of the results of activities.- Looking into the linkage between technical cooperation and other WTO activities, on
the one hand, and the links between the WTO's activities and those of other relevant
international and regional organizations, on the other,  with a view to better defining
these activities and identifying existing and potential synergies.
(c) Making proper use of available resources:
- Analysing administrative and management aspects.
- Appraising the degree of sustainability of activities in relation to available resources.
(d) Noting all the lessons to be learned from experience, with special attention being paid to the
potential impact of technical cooperation on human and institutional capacity building at both
national and regional levels.
2. Scope of the evaluation process
The evaluation could be based on both micro (activity) and macro (programme) approaches.
The evaluation of WTO technical cooperation could therefore address the following interactive and
complementary levels:
(a) Stand-alone activities (e.g. seminars);
(b) regional projects and programmes (e.g. JITAP and Integrated Framework);
(c) specific topics (e.g. customs valuation);
(d) the programme as a whole (all technical cooperation activities).
All activities (subparagraph (d)) could be evaluated on a geographical and  topic-oriented
basis by analysing the extent to which these activities contribute to attaining the set objectives at the
level of a given region and in relation to a specific topic (e.g. the relevance, performance and impact
of WTO technical cooperation in a given region from 1995 to 1999 with respect to customs
valuation).
3. Dimensions of the evaluation and WTO mission
For the purposes of evaluating the quality of WTO technical cooperation activities, three
dimensions should be assessed as objectively as possible.  These are the relevance, performance and
success of the activities, considered individually and collectively.
(a) The relevance of an activity or a set of activities can be gauged by the validity and timeliness
of the objectives set for these activities in relation to:WT/COMTD/W/73
Page 4
- The national, regional and international contexts of the beneficiaries.  The evaluation
must take account of this important dimension, which encompasses the level of
development of the beneficiary country, its regional economic relations and its degree
of integration into the multilateral trading system.
- The real needs of direct beneficiaries and end users of technical cooperation.  The
beneficiary country's evaluation of its technical cooperation needs and their
formulation in consultation with the WTO Secretariat comprise the groundwork
necessary for assessing the relevance of an activity or programme.
- The mission, competence and comparative advantage of the WTO in relation to other
relevant regional and international organizations.
(b) The performance of WTO technical cooperation programmes can be measured by assessing
the progress made in relation to the set objectives.  This entails looking at inputs and
immediate results.  Performance criteria often address:
- Efficacy, which should reflect the extent to which objectives have been attained and
products delivered (e.g., assessing the outcome of a workshop on the Dispute
Settlement System by verifying the quality and content of presentations, audience
participation and audience reactions during and after the workshop).
- Efficiency, which requires optimal transformation of inputs into products
(e.g., evaluating the results achieved following the establishment of a WTO
Reference Centre by ascertaining whether it is effectively operational, whether there
have been immediate benefits for users and whether the results can be achieved with abetter use of resources).
- Punctuality, which presupposes that inputs and results are produced on time.  The
evaluator should pay special attention to the time-frames for the completion of
activities.
(c) Success is a dimension that generally becomes evident in the longer term, especially in the
case of technical cooperation activities such as those of the WTO, targeted mainly at policies,
institutions and capacity building.
Hence the success of WTO technical cooperation depends, first and foremost, on the impact
on the beneficiaries and should be reflected in a change in their situation in the wake of thecooperation activities. An active participation in the WTO processes could be one of the indicators to
measure the impact.
Success will also depend in large part on the sustainability of the results, especially in terms
of capacity building, even after the termination of the WTO technical cooperation activities.  Theautonomy of the recipients must be one of the long-term objectives of any technical assistance (e.g. in
the medium term, the evaluator should verify the degree of participation by a country, group of
countries or region in the various WTO processes and the extent to which it makes use of the
Organization's mechanisms.  In the long term, the evaluator should also consider the ability of the
country, group of countries or region to take maximum advantage of the multilateral trading system,together with the evolution of its share of world trade).WT/COMTD/W/73
Page 5
4. Monitoring mechanisms and types of evaluation
(a) The evaluation process is supplemented by monitoring, an ongoing exercise consisting of
methodical data collection designed to verify whether:
- The promised material and financial contributions have been delivered and are
sufficient;
- the human resources deployed have the required skills;- implementation is in line with the work programme.Monitoring also makes it possible to suggest ways of remedying any shortcomings detected.
In addition to the Three-Year Plan adjust ed on an annual basis, the Annual Report on
Programme Implementation and the Financial Report, the following means will be used to ensure
follow-up of WTO technical cooperation:
- An annual work programme giving an operational description of activities.  This will
describe the provision of inputs, the means of carrying out activities and the expected
results.  It will establish the time-frames and the responsibilities attaching to the
provision of inputs and the generation of results.  The work programme will be drawn
up on a geographical and topic-oriented basis so as to facilitate monitoring and
ultimately evaluation.  These elements will be determined in close cooperation withthe beneficiaries and the timetable will be sufficiently flexible to allow for any
constraints.
- Interaction with the beneficiaries at regular intervals so as to obtain feedback.  The
various means of interaction include telephone or electronic contacts, questionnaires,interviews and on-site visits, where necessary.
- The systematic preparation of short reports following each activity and longer ones
following the completion of a programme.  The longer reports will contain suggested
adjustments.
(b) Types of evaluation
There are various types of evaluation, depending on the classification criterion selected.
Depending on the choice of evaluator, the evaluation may be internal or external.  It may be mid-term
or a posteriori  (ex-post facto), depending on when it takes place.  In terms of scope, it may be sectoral
or by topic, project, programme, approach and/or policy.
In addition to the possibility of a three-year external evaluation, the guidelines for WTO
technical cooperation set out in document W/COMTD/8 also envisage an annual evaluation.  Its
primary purpose would be to determine relevance, performance and the problems encountered and
lessons to be learned with regard to the planning, implementation and management of technical
cooperation activities.  It would also cover an evaluation of the medium- and long-term impact onrecipients.
The evaluation of WTO technical cooperation could be conducted on a geographical and
topic- oriented basis, as previously indicated in Section 2 concerning the scope of the evaluation
process.WT/COMTD/W/73
Page 6
5. Planning and conduct of an evaluation
In keeping with the guidelines for WTO technical cooperation and pursuant to a decision by
the Committee on Trade and Development, the responsible parties are required to design a framework
that reflects the main elements of the evaluation, the terms of reference, the methodology and the
timetable to be followed.  For practical reasons, the evaluation is generally made on a selective basis.The stages of an evaluation may be summarized as follows:
(a) Developing a data collection and analysis methodology, which should be based on the
issues and problems to be addressed, and establishing a procedure for the preparation
of reports (method, frequency and distribution);
(b) identifying specific technical cooperation objectives, structuring them into a logical
framework and linking them to success indicators;
(c) determining indicators by data type and source.  The identification of indicators is
explained in Section 6 below;
(d) discussing the indicators with the Secretariat staff concerned, the beneficiaries and
the donors so as to define identifiable and practical indicators;
(e) data collection and analysis.
With respect to documents and traditional and computer-based support material, data
collection and analysis can be based on questionnaires and a reading procedure which permit an
assessment of content quality, presentation, usefulness, and quality of references and distribution.
In the cases of seminars, workshops, training courses and technical missions, data collection
and analysis will be based on questionnaires, interviews and observation, as well as on other means to
be explored such as evaluation meetings with training course participants (see Annex  III, model
questionnaires).
(f) Preparation of reports
- A short report on each activity evaluated;
- an interim evaluation report to be drawn up halfway through the evaluation;
and
- a final evaluation report to be submitted to the CTD.
6. Identification of indicators
In general terms, indicators signal changes of situation or specific results.  They show
whether the objectives set for activities have been attained.
In the context of WTO technical cooperation, the indicators are predetermined characteristics
that should be established during the programming and planning phase and in evaluating the needs of
beneficiaries and setting specific objectives.  In this connection, thought should be given to the aims
of the activities, the target beneficiaries and their needs, the changes expected to result from the
activities, the degree of efficiency with which the activities achieve their aims and its measurement, as
well as to the criteria to be used for gauging the success of the activities (impact, sustainability andcontribution to capacity building).WT/COMTD/W/73
Page 7
Quantitative, qualitative and approximation criteria may be used.  The first will serve to
calibrate the results of activities in volume terms and on the basis of a cost-effectiveness approach
(e.g. the number of reference centres set up over a given period and the cost-effectiveness ratio
between the products used and the results obtained).
Qualitative indicators will be used to assess behaviour and attitudes with a view to measuring
the impact and sustainability of the results (e.g. reference centres are operational;  the flow of
information between the WTO Secretariat and the responsible national entities has improved;
participation in all WTO processes is effective and efficient;  etc.).  The trade policy review
mechanism could be used as one of the sources for identifying and verifying qualitative indicators.
Approximation indicators will be used when data are hard to come by.  They help to pinpoint
performance trends, potential problems and signs of success (e.g. beneficiaries' efforts to request more
detailed information following one or more techni cal cooperation activities;  specific requests from
reference centres;  etc.).
To provide a structured framework for these tasks, it is recommended that the "logical
framework" method be used.  This method, widely adopted by numerous regional and international
institutions, establishes an analytical structure fo r the aims of technical cooperation and involves an
approach that makes it possible to link these objectives to performance indicators.  It also permits the
identification of external factors that affect the attainment of the objectives, known as "assumptions"(see Annex I).
It should be pointed out, however, that the logical framework is an evolutionary instrument
that calls for continual consultation with all the pa rties involved in order to improve the content (see
Annex I, the logical framework developed for monitoring and evaluating WTO technicalcooperation).
7. Rating system
The rating system is of crucial importance to the evaluation process in that it serves to
formulate and confirm a judgement on the relevance, performance and success of technical
cooperation activities by means of a scale of numerical, alphabetical or descriptive codes.  It should
be used in connection with the questionnaires designed to elicit feedback from beneficiaries (see theproposed questionnaires in Annex III).
The following is recommended for establishing a rating system:- Set the parameters of the values to be assessed according to whether they measure
relevance (highly relevant, relevant or irrelevant)/(very appropriate, appropriate or
inappropriate);  performance (excellent, average or poor);  or success (highly
satisfactory, satisfactory or unsatisfactory);
- use numerical codes with descriptions to facilitate the statistical analysis of the
questionnaires;
- there should be an even number of parameters in a rating system in order to avoid the
choice of a median rating;
- carefully study the questions to be asked so that they properly reflect the specific
criteria of relevance, performance and success (e.g., among the topics dealt with at
the seminar, which were the most appropriate and most useful in relation to yourWT/COMTD/W/73
Page 8
official duties?  Among the topics dealt with at the seminar, which were effectively
covered, which less effectively covered and which not covered effectively at all?).
8. Preparation of reports
The monitoring and evaluation reports are invaluable instruments and sources of information
that can form the basis of decision-making and learning for the purposes of the implementation and
future orientation of technical cooperation.  They enable the technical cooperation activities database
to be supplied with evaluative elements, in partic ular, information as to the relevance, performance
and success of such activities, as well as lessons to be learned.
(a) Monitoring reports will be prepared during implementation with a view to identifying
relevance and performance factors and early signs of potential problems or success.  Ifnecessary, these reports should include practical recommendations as to any remedial or
reinforcing measures that may be required during implementation.  Monitoring reports will be
based on an analysis of the data obtained by observation and bilateral contacts by studying
documents and materials and from the questionnaires filled out by direct beneficiaries.
(b) The evaluation reports emphasize relevance and performance, as well as the measurement of
success at all stages of conception and implementation.  Evaluation reports should contain a
status analysis, an overall evaluation, findings, conclusions, recommendations and lessons to
be learned (see Annex II, the basic format and broad outlines of an evaluation report).  These
reports will draw on the data contained in the monitoring reports and on a global analysis andassessment of technical cooperation activities. Evaluation reports should be submitted
annually to the CTD, which will discuss them, taking into account any other report that the
beneficiary members might wish to present for the same purposes.
9. Use of conclusions and recommendations
The conclusions and recommendations should be set out in the evaluation report and
submitted annually, for discussion, to the Committee on Trade and Development, which will take the
appropriate decisions, taking into account the reports presented by beneficiary members.  After the
Committee examines the report, the approved conclusions and recommendations will be
communicated for all relevant purposes to the Secretariat staff concerned, to the responsible parties in
beneficiary countries and to donors.
They will become part of the institutional memo ry once the main elements of the evaluation
have been extracted from the reports and entered as files in the computerized database so that they can
be easily found and accessed.
10. Lessons to be learned
The same goes for the lessons to be learned.  Experience which can be turned to account in
formulating, implementing, monitoring and evaluating WTO technical cooperation activities will be
pooled.  The main thing is to be able to identify the lessons applicable immediately or in the future
and capable of enhancing the quality of technical cooperation.  These lessons must be structured in the
same way as the conclusions and recommendations, that is, by emphasizing the criteria of relevance,performance and success.
To extract lessons that can be usefully applied to present and future WTO programmes, the
evaluation should be made on a geographical and thematic approach that makes it possible to collect
transposable material, in other words, lessons applicable as widely as possible to activities acrossmore than one country.WT/COMTD/W/73
Page 9
The lessons drawn from experience and captured in the monitoring and evaluation reports will
be systematically disseminated to the parties concerned.
All members of the Secretariat should have access to this information via the computerized
database mentioned above, as well as through the mechanisms in place for consultation among WTO
divisions.
The data should also be made available to beneficiary countries through publications and
reference centres, as well as to donors.
The relevant lessons will have to be incorp orated into new WTO technical cooperation
programmes.  Secretariat officials responsible for the planning and implementation of technical
cooperation, in consultation with the beneficiaries, must take account of the relevant lessons and
incorporate them as appropriately as possible into ongoing and future activities.
If the conclusions, recommendations and lessons are to be effectively and efficiently built into
WTO technical cooperation policies, all the participants (Secretariat, beneficiaries and donors) must,
in planning their programmes and activities, bear in mind that monitoring and evaluation are an
integral and indispensable component of the overall management cycle and that everyone is
responsible for the performance of the activities at his or own level.
It is equally important for beneficiary countries to be associated with the monitoring and
evaluation process right from the activity planning stage, especially as regards the identification of
performance and success indicators.  A culture of evaluation should be fostered among WTO
Secretariat staff and beneficiaries.WT/COMTD/W/73
Page 10
 ANNEX I
 MONITORING AND EVALUATING WTO'S TECHNICAL COOPERATION
 LOGICAL FRAMEWORK
Intervention logic Indicators Verification Assumptions
Overall
objectives• Assist in the full
integration of beneficiaries
into the MTS and contribute
to the expansion of their trade
• Strengthen and enhance
institutional and humancapacities for an appropriate
participation in the MTS
Target beneficiaries:
-LDCs and developing
countries members
- member countries in
transition
- Countries in accession
Target participants:
-Government officials
-Private sector representatives
-UniversitiesDevelopment of country
share in the world trade
(target percentage  )
Country appreciation
Improved trade policy
Effective participation in
the WTO process
The right countries are
involved
The right persons and
institutions are involvedNational and
international
information bases
National sources
and TPR
mechanism
Interaction with
members and WTO
Secretariat
Number and
relevance of
countries involved
( Systematic
verification )
Number and
relevance of
persons involved
(Systematicverification)Clear choice
of strategies
and policies
and countryinvolvement
WTO
institutional
partners andtrading
partners are
supporting the
overall effort
More regular
participation
in the work of
the WTO
Continuity in
the nomination
of participants
and task
assignment at
national leveland reliable
selection
process
Specific
objectives• General dissemination of
an overview of the WTO
and its agreements  and
building information linkswith beneficiary countriesLooking for more detailed
information on trade or the
MTS (number of requestsand web site visits ).
References Centres are
operational (number of
ORCs)
Improved information flow
between WTO Secretariat
and country officialsverification
procedure based on
country actions andon the IAMD.
Information from
countries and
interaction with theWTO.Existence of
political will
to make RCoperationalWT/COMTD/W/73
Page 11
Intervention logic Indicators Verification Assumptions
• Upgrading of human
resource skills and
institutional capacities  for
an effective participation in
the WTO processes and afull use of its provisions
• Building of specialised
knowledge and
institutional capacity
required for theimplementation of WTO
agreementsSpecial requests from RCs
Dissemination of
information on the MTS
among governmental
institutions and to the
private sector
Establishment of a national
committee to coordinate
WTO related issues (target
percentage in a givenperiod )
Organisation of follow up
Improved capacity to react
on new and emerging
issues
Designation of an official /
office to be the central focal
point for technical
cooperation activities with
the WTO          ( target
percentage )
Degree of administrative
and institutional capacity
building
( Sustainability )
Use of  all the mechanisms
of the MTS and the WTO
( eg. the dispute settlement
system , safeguard
mechanisms, S&D etc.. )
Appropriate knowledge
basis for faithfulimplementation of the
commitments
Notification requirements
( increased number ofnotification - targetInformation from
countries
Feedback
procedures
Information from
countries
Information from
counties
Information from
countries
Feedback
procedures
Information from
countries and from
the WTO bodies
(eg. DSB )
Information from
TPR andNotification
processes ( CRN)
Information from
concerned WTODivisions and fromInvolved
persons
remains in
relevantpositions
(participants
and trained
persons )WT/COMTD/W/73
Page 12
Intervention logic Indicators Verification Assumptions
percentage)
Adaptation of the national
regulatory framework to theprovisions of the
agreements, including
technical regulations
Enquiry points for TBT and
SPS are established (target
percentage )
Customs valuation (number
of CV- target percentage)
Improved participation in
the IDB(data usefulness,
quality and timeliness )CRN
Information from
countries and from
TPR  and Rules
Divisions
Information from
countries and from
concerned
Divisions.
Information from
the IDB
Concept and
design• Coherence of the activities
concept and design against
the overall objectives
• Comparative advantage of
WTO activities
• Joint elaboration of
specific objectives
(beneficiary country andthe WTO )Presentation of and reaction
on the activities (responses
to TC requests)
Similar activities or other
potential trade-related-TC
providers
Beneficiary country
reactions and WTO
responsesReaction from
target beneficiary
countries and
donors
Consultations with
concerned parties
Specific
questionnairePriorities have
been identified
at national
level
Activities • General Seminars for
explanation anddissemination of
information on the WTO
• Establishment of WTO
Reference Centres
• Seminars and workshops to
deal in-depth with specific
issuesQuality of faculty and of
audience.
Timeliness of
implementation
Number of ORCs and
volume of exchanged
information.
Interaction between RCs
Quality of faculty and of
audience.
Timeliness of
implementationSystematic
feedback procedure
Systematic
verification
procedure
Systematic
feedback procedureRegional and
sub-regional
organisations
are involved in
trade-related
matters and inTC activities
Reliable
selection
processWT/COMTD/W/73
Page 13
Intervention logic Indicators Verification Assumptions
• Technical missions
• Training courses
• Practical training
programmes for selected
officials with specificresponsibilities
• Information technology-
based training materiel
• Supply of data on trade and
tariffs and otherdocumentation on the
WTO
• Documentation  for
implementation matters
(notification and legislation
models)
• WTO participation in TC
organised by regional and
other internationalinstitutionsQuality of inputs and
outputs (eg. Legislation ortechnical regulation draft )
Timeliness of
implementation
Quality of faculty and of
audience.
Sustainability
Timeliness of
implementation
Quality of output anddissemination.
The right document must
be disseminated.Timeliness of
implementation.
Quality of faculty
Timeliness of
implementation.Active participation of the
WTO StaffSystematic
feedback procedure
Systematic
feedback procedure
Reaction of the
trainees
Systematic
feedback procedurebased on
questionnaires and
readership surveys
of internal
documents
Systematic
feedback procedureFollow up at
national level
Reliable
selection
process
Coordination
pre-
established
Administrative,managerial and
financial
aspects ofimplementation• Administrative elements of
the implementation
• Managerial elements of the
implementation
• Financial elements of the
implementationSelection of staff and
consultants / task
assignment
(Strengthening of WTOSecretariat)
Communication with all
concerned parties in the
WTO  Secretariat
Compatibility between
financial plan and
implementation planSystematic
verification
procedure
Systematic
verification
procedure
Systematic
verification
procedureFinancial
resources are
available andWT/COMTD/W/73
Page 14
Intervention logic Indicators Verification Assumptions
sufficient
Coordination • Interdependence with
overall WTO activities.
• Interdependence with
activities of other relevant
regional and international
organisationsImproved in-house
coordination ( coordination
mechanisms function )
Internal consultation
process strengthened
Coordination of the
activities and  policy
coherence improvedSystematic
verification
procedure
Inter-divisional
mechanisms
Political will
to enhance
coherence
betweendevelopment
objectives and
policies of the
IO concernedWT/COMTD/W/73
Page 15
 ANNEX II
 BASIC FORMAT AND BROAD OUTLINES OF AN EVALUATION REPORT
I. INTRODUCTION
II. ACTIVITIES:  ANALYSIS OF THE SITUATION AND FORMULATION OF
CONCLUSIONS
1. Preparing and disseminating documents and support and training materials
2. Organizing seminars, workshops, technical missions and trade policy courses
3. Communicating data, inter alia , on trade and customs duties
4. Setting up reference centres
5. Joint projects and participation in technical assistance activities organized by other
regional and international institutions
6. Coordination
III. OVERALL EVALUATION AND RECOMMENDATIONS
A. Concept and design
B. Budget and financing
C. Implementation of the activities
1. Beneficiaries receptivity
2. Comparative advantages of the WTO
3. Capacity of the teams supplying the Technical cooperation
4. Programming of Technical cooperation activities
D. Intervention areasE. Interaction with other WTO activities
F. Coordination
1. Within WTO structures
2. With other appropriate regional and international organizations
G. Coverage, relevance and impact of WTO technical cooperation activities
1. Africa
2. Middle East3. Asia-Pacific region
4. Countries of Central and Eastern Europe
5. Latin America and the Caribbean
H. General conclusions
IV. RECOMMENDATIONSWT/COMTD/W/73
Page 16
 ANNEX III
 EVALUATION QUESTIONNAIRES
Participants Evaluation /Feed-Back Form
(Seminars, workshops , conferences and training events )
Filling out this questionnaire will help us to  further improve and adapt our future technical
cooperation activities. Thank you in advance for your collaboration.
1.(a) What are your main objectives in participating in this event ?
Obtain general information about the WTO and the Multilateral Trading System
Obtain in depth information about specific agreements -- Which ones?
                                                                                                                                                          
Address implementation issues relating to the WTO Agreements
Obtain information on built-in-agenda (e.g. Agriculture, Services and Intellectual Property.)
            Obtain information on other issues in the Multilateral Trading System
             (e.g. investment , competition policy, etc..)
1.(b) Were your main objectives met ?
Yes, largely moderately not entirely No comment
Please give a short explanationTitle of event :
Date(s) and location :Please indicate your area of activity:
  
   Government                            Business                                OtherWT/COMTD/W/73
Page 17
2. How would you rate the event you have just attended ?
Excellent Good Satisfactory Not satisfactory
Content
(substance)
Structure (topics)
Presentations(quality)
sufficient Not sufficient No comment
Duration of theevent
Very useful Useful  Not useful No comment
Documentation
3. Were the documents for the event made available at an appropriate time?
Most appropriate Appropriate Not appropriate No comment
4. Which documentation or handouts were the most useful?a. b.
c. d.
5. How  do you rate the logistical arrangements for the event?*
Excellent Good Satisfactory Poor
Travel arrangements
Accommodation
Conference room
Other
                                                     
* My not always be applicableWT/COMTD/W/73
Page 18
6. Which part(s) of the programme and/or topic(s) did you find most useful?  Please
explain, if necessary
a. b.
c. d.
7. Which areas or aspects, in your view, were not adequately covered? Please explain, if
necessary
a. b.
c. d.
8. Was too much time allocated to a subject ? If so, to which one(s)?
9. Which areas or topics, in your view, were not included in the programme but would
have been useful to your duties?
a. b.
c. d.
10. How will you use the information provided during this event?
     Disseminate information to:   Public sector
 Private sector Other
      Use the information to train others      Provide input into formulation of policy questions on WTO issues
      Improve own working performance
Organise similar events at national level
      Other. Please specifyWT/COMTD/W/73
Page 19
 11. Does this event require a follow up?  Please check the following boxes:
       At national level             /g240   for business community and/or Universities/ Research Centres
       /g240   for government officials
       /g240   for government officials and  business community
/g32        /g240 With the participation of regional and/ or sub-regional institutions
       At regional level               With the participation of regional and/ or sub-regional institutions
Please give a short  explanation  to your answer to question  11WT/COMTD/W/73
Page 20
Technical Mission♣
Evaluation /Feed-Back Form
Filling out this questionnaire will help us to  further improve and adapt our future technical
cooperation activities. Thank you in advance for your collaboration.
1. Were your objectives met?
Yes, largely Moderately Not entirely No comment
Please give a short explanation
                                                     
♣ Technical missions are organized to assist countries in specific tasks related to effective
implementation of WTO commitments, such as preparing legislation, regulations and notifications, as well as to
facilitate understanding of specific issues.Subject of the mission :
Date(s) and location :WT/COMTD/W/73
Page 21
2. How would you rate this mission programme?
Excellent Good Satisfactory Not satisfactory
Structure of the
programme
Very useful Useful Not useful No comment
Documentation
and materialprovided
Most relevant Relevant Least relevant No comment
Relevance of thecontribution made
by resource
person(s)
3. Which part(s) of the mission programme did you find most useful to your work?  Pleaseexplain, if necessary
a. b.
c. d.
4. Which areas or aspects, in your view, were not adequately covered?  Please explain, if
necessary
a. b.
c. d.
5. Was too much time allocated to a subject ? if so, to which one(s)?WT/COMTD/W/73
Page 22
6. Which aspect(s), in your view, were not covered by the mission programme but would
have been useful in meeting  your objectives?  Please explain, if necessary
a. b.
c. d.
7. Does this mission require a follow-up ?                      Yes                               No
Please give a short  explanationWT/COMTD/W/73
Page 23
WTO  Reference Centres
Evaluation  questionnaire
Filling out this questionnaire will help us to further improve and adapt our technical
cooperation activities related to the  WTO Re ference Centres. Thank you in advance for your
collaboration.
1. Did the training on the use of information resources provided by the WTO team meet
your expectations ?
Yes, largely moderately not entirely No comment
2. Were there any subjects  not covered in the training  but would have been relevant to
your official duties? Please identify them?
3. Is  the computer equipment  provid ed by the WTO operational today?
Yes No No comment
If not, please explainCountry :WT/COMTD/W/73
Page 24
4. Did Internet connections operate adequately ?
Yes No No comment
If not, please explain
5. Are the documents provided by the WTO re levant to the operation of the Reference
Centre?
Most relevant Relevant Least relevant No comment
If not, please explain
6. What will be the main use of the WTO Reference Centre?
             Access to electronic training tools
            Access to information
Maintain ongoing  contact with the WTO
             Other
Please specifyWT/COMTD/W/73
Page 25
7. What follow-up, in your view, might be required.  Please explain
a) Training d) Software
 b) Computer maintenance e) Docume ntation/ setting up Reference Centre
library
c) Hardware f) Other
__________