Managerial assessment of proficiency

The term managerial assessment of proficiency (MAP) describes a methodology for the assessment of managerial competence in human resource and training applications. MAP is designed for evaluation of a manager's proficiency in 12 prescribed competencies, and other criteria. Assessments can be generated for an employee, as well as for a department or the organisation as a whole.  Normative values, used for comparative purposes in each assessment, are based upon the performance of over 110,000 managers, across 17 countries, in more than 600 organisations that have used MAP, according to the UK-based company, Development Processes Group plc, that licenses the tool into organisations. The Managerial Assessment of Proficiency - (MAP2), copyright 2012, 2014, HRD Press, Inc. is an assessment tool published by HRD Press, Inc. Amherst, MA USA, and is available throughout the world. "Development Processes Group plc" is the exclusive representative in the United Kingdom.

The 12 competencies are fundamental in determining the proficiency of an effective manager, according to the methodology. Implicit in the approach for developing managerial excellence is the definition of the competencies: a "group of related skills, knowledge, and attitudes that correlate with success in one’s job and can be improved through training."

MAP assessment process
Dr. Scott Parry, founder of Training House, Inc.,creator of the tool and 1999 inductee into the ASTD (ATD) and, Academy of Resource Development, Halls of Fame, developed the MAP competency framework by first analysing the results of a series of large competency studies conducted by a number of major organisations. Dr. Parry, sold Training House in 1999 to HRD Press, Inc. who authorized Development Processes Group, plc as the exclusive representative and developer of the MAP assessment within the United Kingdom.  Cliff Lansley leads the further development of MAP with fellow Director Cameron Robertson has used the tool in studies across hundreds of major public and private sector organisations and he says' "we now have powerful benchmarking data of leadership competencies across most organisational sectors. What is unique here, is that MAP is the only objective diagnostic tool for managerial and leadership compenece measurement that exists in the world. All other tools are based merely on self-report, 360 degree opinion or subjective judgement by an assessor".

The studies looked at a number of leading corporations to identify the competencies and attributes that were important to the performance of managers. IBM, AT&T, Henley Management College, Ford and Kodak came up with very similar managerial competencies and these were analysed. The developers of MAP selected 12 of the most frequently mentioned competencies, those common to most frameworks, and arranged them in 4 clusters and 2 broad categories: task-handling (left column) and people-handling (right column).

Dr. Scott Parry, developer of the MAP Assessment competency framework and tool, defines competencies as "a group of related skills, knowledge, and attitudes that correlate with success in one’s job and that can be improved through training”.

The assessment involves studying a series of real-life management situations covering a week in the life of a typical manager and his team and answering a series of questions about your judgement of what you've seen.

The situations covered include:

 team meetings
 time management
 delegating
 discipline and empathy
 appraising staff
 performance management
 problem solving
 listening.

Following each short scene the delegates answer a series of questions based on what they have been watching. They are then asked if, in their opinion, the management behaviour they have seen is good or bad practice.

The scenarios are very effective in getting managers to be a part of the assessment process because they are based on the real situations that they regularly have to deal with on a day-to-day basis, resulting in high face validity scores.

There are also two paper-based questionnaires that help determine their preferred styles of managing and communicating and the impact that can have in the workplace.

At the end of the day the assessment is scored online and a personal profile produced within minutes. This is in readiness for Day 2 of the MAP Assessment process.

The second day of the process is the interpretation of the assessment scores providing delegates with a development ‘road map’ for their ongoing development.

If a team is being assessed then a group profile is also produced to take into account the department or team's training and development needs.

Validating the MAP assessment
Before making the assessment available to clients, Cliff Lansley, one of the developers of MAP validated the methodology in 11 organisations. Managers were selected to cover the full range of proficiency at work from ‘excellent’ to ‘below average’. Working independently, three senior managers assigned ratings on a 5-point scale to each manager being assessed, thereby establishing a rank order.

A total of 253 managers from 11 organisations went through the video-based assessment. Their overall proficiency percentiles (average of the 12 competency scores) were compared with their senior managers’ ratings of their performance at work, using the Spearman's rank order correlation analysis.

Correlations were positive, ranging from .71 to .92. This supported the following assumptions:-
the competencies that were assessed enabled the developers to discriminate between high performing managers and their less effective counterparts,
the assessment instrument could therefore be used as a predictive index of one's performance on the job,
the process constituted the basis for a ‘needs analysis’ for identifying training and development opportunities.

Cliff Lansley, Director and owner of Development Processes Group plc, the lead organisation for MAP across the UK, is undertaking an extended research and validation exercise and the results will be referenced on completion.

The construct validity can be measured by the degree to which the developers’ assessment data agrees with the actual performance of managers at work. But participants are also concerned with face validity, the degree to which they can identify with the video episodes and accept their proficiency profile as accurate. On the post-assessment evaluation sheet, 92% said they had no difficulty relating to the episodes, and 86% said that the scores they received were probably accurate.

A further examination of the list of 12 competencies will support the assumption that they can all be improved via training. This is in contrast to the characteristics, qualities, and attributes that appear in some organisations’ lists of competencies¼ self-confidence, initiative, flexibility, ambition and so on. These are best defined as personality traits, not competencies, according to Dr. Scott Parry. They are typically formed early in life and, short of clinical intervention, are not subject to significant change through participation in a training programme. The developers of MAP restricted the assessment to competencies that can be developed through training.

Impact of MAP
Famous chef, Raymond Blanc, experienced the tool himself and he outlines in the link below how he used MAP within his organisation and found it to be a good predictor of managerial performance.

MAP has also been used as a central part of qualifications accredited by the Institute of Leadership and Management and the Chartered Management Institute.

MAP has been deployed across the UK by a range of Licensed Delivery Centres by Development Processes Group PLC. One of its centres, Metricate Ltd, have supported its work in assessing and researching competencies in the construction, engineering and logistics industry sectors. The goal was to identify the implications of any deficiencies for the businesses concerned and assess how and where they impacted upon the organisation. (‘Understanding the Real Skills Gap: Management and Leadership’ 2008, Metricate Ltd).

The specific management competencies in deficit on this study, according to a MAP analysis, were identified as:-

Training, coaching and delegating
Thinking clearly and analytically
Listening and organising

From follow-up interviews with managers at Company Board level, there were a number of strategic and operational problem areas for companies stemming from the deficit in the management competencies described:-

problems with succession planning for the business and key staff
low profitability: chasing turnover at the sacrifice of margin
poor productivity: unproductive use of staff at all levels
response to globalisation: failure to grow and compete with larger rivals
new environmental, technology, techniques, legislation: struggling to respond and develop commercial advantage 
aging workforce: inability to recruit and retain sufficient new staff
skills gaps: staff lacked the management and technical skills to compete successfully

Specification of a development program
The work of Metricate Ltd went on to confirm in their study that development programs were most effective in resolving the deficiencies in competence where they met the following program design specifications:-

A thorough needs analysis undertaken at the outset, to support an agreed understanding of the problems and desired outcomes
MAP measurement before and after the intervention, and against relevant industry and national benchmarks
The development program should be led ‘from the top down’, with active endorsement by the directors
Training program targeted at three levels simultaneously: the individual, teams and the organisation
Customized to organizational challenges and personalized to individuals’ needs: this is achieved through interviews, following MAP assessment
Modes of delivery matched to all learning styles: such as workshops, coaching and self-study
Development of a cross-functional approach involving different teams/ departments, to ensure an integrated understanding of the issues for the organization
Establish self and organizational awareness, to embed a culture of autonomous development 
Programme over an extended period – ‘little and often’ – up to 12 months, to ensure assimilation and minimise the disruption of training
Post development assessment to measure progression and ROI (Return on Investment)

See also
Human resources

Websites and links
  Assessment Information
  Linked Training
 studies and product details about MAP
 a round table discussion on MAP with Cliff Lansley
 the national training and development organisation responsible for MAP, based in the UK
  the MAP tool explained in detail
 Raymond Blanc's experience with the diagnostic tool
 HRD, Academy of Resource Development, Hall of Fame – the Award is presented to scholars in human resource development and related disciplines http://www.ahrd.org/mc/page.do?sitePageId=56783
  Metricate, one of the DPG plc Licensed Delivery Centres providing assessment and development programmes for the construction, engineering and logistics sectors
  Article: Performance management masterclass: the fifth TJ roundtable discussion hosted by DPG plc and Dr Peter Honey examined the impact performance assessment has had on the ever-changing role of the manager

Books
HRD Manager's Route to Competence: Cliff Lansley; Developing a Strategic Approach to HRD v. 3 (Paperback); 

 Design Learning Programmes: Cliff Lansley; (Paperback0; 

Training for Results; Scott Parry; ASTD March 7, 2000; 

Human resource management