eunbil · GT0N1597 · 2006-07-14 00:00:00 — It provides a platform for exhaustive presentation and comparability of existing evaluation results, and identification of any information gaps. Whilst taking into account the fact that evaluation is more advanced for some activities than others, it will allow the of a common set of minimum evaluation requirements across the different policies. Evaluation of Community programmes Evaluation of programmes is well developed within the Commission, including in the area of freedom, security and , where major programmes such as , AGIS and are regularly evaluated . Available evaluation results demonstrate that whilst the immediate results of funding programmes are easily identified and measured, their longer-term effects are sometimes more difficult to grasp. In this context, the Commission proposals for the 2007-2013 programmes on freedom, security and establish a better link between the programmes" specific objectives and the overall political objectives. This will have an impact on the evaluation framework for these programmes, in particular through assessment of their consistency with other instruments (legislative or other) in the same field. Contrary to the evaluation of programmes, evaluation of legislation is a more recent development in the case of freedom, security and . Recent examples include the evaluation of Arrest Warrant (2005), the economic evaluation of the Data Protection Directive (2005) and the on-going evaluations of the Directive on minimum standards for the reception of asylum-seekers and of the I Regulation . Also, the introduction of impact assessments of EU legislation has led to systematic ex-ante appraisal, which should greatly facilitate further interim and/or ex-post evaluation. In this context, systematic scrutiny of legislative proposals and other draft instruments to ensure that they are compatible with the Charter of Fundamental Rights should serve the same purpose . Mechanism for Schengen evaluation The Schengen evaluation system, first established in the intergovernmental Schengen framework and then integrated into Union framework , assesses correct implementation of the Schengen acquis by participating Member States through a peer review mechanism, including visits to Member States. It has issued restricted reports, given details of cases of non-compliance with existing rules and practices and made further recommendations. This mechanism applies to both Community and third pillar measures. When internal border controls with and between new EU Member States are lifted, the Commission will submit a "proposal to supplement the existing Schengen evaluation mechanism with a supervisory mechanism", as requested by The Hague Programme. Mechanism for the fight against organised crime Joint Action 97/827/JHA, adopted by the Council on , established a mechanism for evaluating the application and implementation at national level of international undertakings in the fight against organised crime . Two rounds of evaluation have already been completed and two others are ongoing. The first round focused on mutual legal assistance in criminal matters, on which a report was subsequently released on 1 2001 . The second assessed instruments dealing with law enforcement and drug trafficking. Finally, the third and fourth rounds, not yet completed, are evaluating exchanges of information and intelligence between the Member States and Europol and Arrest Warrant respectively. The 1997 mechanism is operated by teams of experts designated by Member States, assisted by the General-Secretariat of the Council, with the involvement of the Commission. It is based on study visits and allows an in-depth examination of how instruments or policies are working in practice. The Commission believes that although this mechanism has proved useful and effective, it nevertheless has some shortcomings, in particular the total duration of the process, the scope limited to only matters related to organised crime and the limited dissemination of the evaluation results. Mechanism for the fight against terrorism Following the conclusions of the extraordinary meeting of the and on , the Council set up a procedure for peer assessment of national anti-terrorist arrangements in the framework of international cooperation between Member States. The first round of evaluations started in 2003 and focused on exchanges of information. Evaluation teams are made up of national experts and their reports are confidential. Evaluation of the EU Action Plan on Drugs In 2004 the Commission carried out the final evaluation of the EU Drugs Strategy and Action Plan on Drugs for 2000-2004 , in cooperation with () and Europol. The evaluation exercise provided an overview of the drugs situation in Union over the reference period. The Strategy and the Action Plan included a wide range of drug-related measures, mainly within the competence of the Member States. Their impact on the drug situation in Union could not be considered, mainly because the EU Strategy and Action Plan failed to establish impact indicators. The EU Action Plan on Drugs for 2005-2008 takes into account the evaluation of the preceding Action Plan and has been designed from the outset to facilitate full evaluation. Accordingly, it clearly allocates responsibilities for each action and includes specific assessment tools, indicators and schedules for implementation. The Action Plan provides for the Commission to present annual reviews of implementation of the Plan plus a final evaluation in 2008, with a view to preparing the next Plan. The first annual progress review will be presented in autumn . Mechanism for evaluating respect of fundamental rights studies the extent and development of the phenomena of racism, xenophobia and anti-Semitism and analyses their consequences and effects. Its findings are presented in annual reports. Once established, the Agency on Fundamental Rights, with its wider mandate, is expected to play a key role in evaluating respect of fundamental rights. The network of fundamental rights experts was created by Commission in 2002 in response to a recommendation in Parliament"s report on the state of fundamental rights in Union. The network assesses the fundamental rights situation through an annual report, on the basis of an analysis of the legislation, the case-law and the administrative practice of the national authorities of the Member States and in the institutions of the Union. The reference points for the evaluation are the rights set out in Union"s Charter of Fundamental Rights. The results are published annually (so far, in 2003, 2004 and 2005). Activity: A coherent area of action with objectives and resources. In other words, "Activities" consist of well-defined and delimited measures to which inputs are allocated and converted into outputs. The policy for the development of an Area of Freedom, Security and has been divided into different () activities such as: Activity 1802 "External borders, visa policy and free movement of persons", Activity 1803 "Common immigration and asylum policies", Activity 1804 "Citizenship and fundamental rights", Activity 1805 "enforcement cooperation and prevention of and fight against general organised crime", Activity 1806 "Establishing a genuine European area of in criminal and civil matters", Activity 1807 "Coordination in the field of drugs". Evaluation: "Judgement of interventions according to their results, impacts and the needs they aim to satisfy" . It is a process undertaken by the Commission in order to identify what can be learned for policy and planning. Ex ante/ex post evaluation Ex ante evaluation: Evaluation performed before implementation of a measure. For the purposes of the Commission, ex ante evaluation is defined as a process that supports the preparation of proposals for new or renewed Community activities. Its purpose is to information and carry out analyses that help to define objectives and to ensure that these objectives can be met, that the instruments used are cost-effective and that reliable subsequent evaluation will be possible. Intermediate (or mid-term) evaluation: Evaluation performed during implementation of a measure. If the evaluation extends throughout the period of implementation, this is also called "on-going evaluation". This type of evaluation critically appraises the first outputs and results, in order to assess the quality of monitoring and implementation of the measure. The main focus is to help to prepare adjustments and reprogramming and to provide input for the preliminary deliberations on the future of the measures. Ex post evaluation: Evaluation conducted either on or after completion of a measure. The main interest is overall assessment of the measure, in particular by analysing the impact achieved and examining its efficiency. The objective is to understand the reasons for success or failure and the sustainability of the results and impact. It also tries to draw conclusions that can be applied generally to other measures. Impact: A general term used to describe the effects of a measure on society. Impact can be either positive or negative and foreseen or unforeseen. Initial effects are called outcomes/results, whilst impact is usually longer-term. Impact assessment: Impact assessment is about examining the likely economic, social and environmental impact of the Commission"s proposals. It identifies and assesses the issue at stake and the objectives pursued. It identifies the main options for achieving the objectives and analyses their likely impact. It outlines the advantages and disadvantages of each option as well as synergies and trade-offs. Indicators: A characteristic or attribute which can be measured to assess an activity in terms of its outputs or impacts. Output indicators are normally straightforward. Impact indicators may be more difficult to obtain, and it is often appropriate to rely on indirect indicators as proxies. Indicators can be either quantitative or qualitative. Monitoring: A continuous process of examining delivery in terms of adoption and implementation of different measures, especially legislation. It is not to be confused with programme monitoring, which consists of examining the delivery of programme outputs to the intended beneficiaries. Evaluation, on the other hand, is carried out at a discrete point in time, and consists of an in-depth study. Monitoring generates data which can be used in evaluations. Outcomes/results: The intermediate effects of a measure. Policy: A set of activities, which may differ in type (programmes, measures, procedures, laws or rules) and beneficiaries or target groups, directed towards common general objectives or goals. Unlike projects and programmes, a policy is not usually delimited in terms of time or budget. Policy area: Within the EU the concept policy may designate various scope and levels of complexity, ranging from an overall Commission strategy or objective over a policy area to an ABB-activity. In this context, a policy will normally embrace a range of instruments At Commission level, the ABB-activities (215 altogether) have been grouped into some 30 policy areas, closely identifiable with Directorates-General. deals with policy area 18: Freedom, security and . Policy instruments: A set of techniques by which public authorities attempt to ensure support and to effect or prevent social change. In this sense, there is a strong emphasis on the dynamic evolving nature of policies, with individual policy instruments being added, withdrawn or redesigned over time. The variety of available policy instruments includes, for example, legislation such as regulations or directives and may involve resource commitments, for example in the form of operational programmes; they also include Communications, action plans, etc. However, policy instruments differ significantly in the way in which they bring about results and impacts and the timescales over which these can be expected. Programme: A set of organised but often varied actions (a programme may encompass several different projects, measures and processes) directed towards achieving specific objectives, often with a definite time schedule and budget. 1 to the Presidency Conclusions of the , . Council and Commission Action Plan implementing the Hague Programme on strengthening freedom, security and in Union (OJ C 198, , p. The Action Plan also calls for a Communication on the systematic, objective and impartial evaluation of the implementation of EU policies in the field of , with a view to reinforcing mutual trust while fully respecting the independence of the judiciary. Later this year the Commission will present a further Communication which will address this issue in detail, in accordance with the general principles established in this Communication. COM(2006) 333. SEC(2000) 1051. The production of Community statistics is governed by the rules set out in Council Regulation on Community Statistics, and actions on the of Community statistics are carried out according to the Community Statistical Programme and its Annual Programmes, respecting the principles set out in Statistics Code of Practice. To this end, the Commission is planning to adopt an EU plan on developing a comprehensive and coherent EU strategy to measure crime and criminal . The ultimate goal will be to have community statistics based on harmonised definitions and collection and reporting mechanisms. In the third step of the proposed mechanism, the peer review evaluation mechanism described in 2, point 2.3.2 could continue to be carried out. Depending on how the current institutional framework evolves, the Commission could manage this mechanism at a later stage. In any event, the Commission will back up this mechanism with its own in-depth strategic evaluations in the areas covered by Title VI of the . Asylum acceptance rates can at the moment only be roughly estimated with the data currently available, as asylum decisions in one year often relate to applications made in earlier years. With particular regard to preparedness and response to terrorist attacks. Report on the functioning of the derogation system introduced by Regulation 1295/2003 regarding measures envisaged to facilitate the procedures for applying for and issuing visas for members of the Olympic family taking part in the 2004 Olympic or in (SEC(2005) 1051). This report was written by the Commission on the basis of information provided by the Greek authorities. (of ), COM(1999) 127 final and COM(2003) 101 final. Reports on the application of Directive 93/109/EC: of EU citizens residing in a of which they are not nationals to vote in European Parliament elections, COM(97) 731 final and COM(2000) 843, or Report from the Commission to Parliament and application of Directive 94/80/EC on the right to vote and to stand as a candidate in municipal elections, COM(2002) 260 final. Report from the Commission based on Article 11 of the Council Framework Decision of 13 2002 on combating terrorism, COM(2004) 409 final, . Council Framework Decision of 15 2001 on the standing of victims in criminal proceedings. Report from the Commission on the legal transposition of the Council Decision of 28 February 2002 setting up Eurojust with a view to reinforcing the fight against serious crime, COM(2004) 457 final, . Report from the Commission based on Article 34 of the Council Framework Decision of 13 2002 on Arrest Warrant and the surrender procedures between Member States (COM(2005) 63 final), p.2, paragraph 2: "The evaluation criteria adopted by the Commission for this report are, firstly, the general criteria normally used nowadays to evaluate the implementation of framework decisions (practical effectiveness, clarity and legal certainty, full application and compliance with the time limit for transposal), and, secondly, criteria specific to the arrest warrant, principally the fact that it is a judicial instrument, its effectiveness and its rapidity." COM(2006) 67 final. Evaluations of agencies and external bodies have not been included, for example the evaluation of the draft Council Decision transforming () into an EU body, the evaluation of and the evaluation of the functioning of () in civil and commercial matters. The results of these evaluations are available online at: . Council Framework Decision 2002/584/JHA of 13 2002 on Arrest Warrant and the surrender procedures between Member States. Directive 95/46/EC of Parliament and of 1995 on the protection of individuals with regard to the processing of personal data and on the free movement of such data. Council Directive 2003/9/EC of 27 January 2003 laying down minimum standards for the reception of asylum-seekers. Council Regulation (EC) No 44/2001 of on jurisdiction and the recognition and enforcement of judgments in civil and commercial matters SEC(2001) 380/3, COM(2005) 172. Decision 26 DEF 1998 of . For further information see: . Final report on the first evaluation exercise - mutual legal assistance in criminal matters (2001/C 216/02). Council Decision 2002/996/JHA of establishing a mechanism for evaluating the legal systems and their implementation at national level in the fight against terrorism. COM(2004) 707. 2000/2231(). Communication on Evaluation (SEC(2000) 1051): . 11223/06 cz DG H 2 EN System of information gathering and sharing Specific in-depth evaluation report