Establishing an Impostor— Quantitative Assessment in Academia
By: Dr Ben Britton
Tags: Metrics, Academia, Higher Education, University

In studying and considering pathways through academia, I remain staggered at the linkage and reliance of grades as ‘gates’ within the academic system (and beyond). These grades are used devoid of all meaning, apart from highlighting ‘excellence’, and this is found with follow-on courses, access to scholarships, job recruitment and more.

In many instances, the hyper-pressure to achieve and to be ‘the best’ is enshrined in the worth of the recruiting entity. Fundamentally the assessors are cheat in their evaluation of the human being who they wish to recruit, simply in relying on the blunt instrument of a grade.

Thriving of students (and people) in academia is not fair or equal, and I’d argue that the population of people who are simply surviving is even less balanced.

The unbalance of the populations of people is worsened in these unusual times, and perhaps we should also reflect that the prioritisation of time and energy, and our pivot (as instructors and students) towards new technologies creates new ways and new motivations for people to cheat.

In creating this ‘best of a best’ culture, we disproportionally reward cheaters.

We also foster a continue one-up-person-ship between peers, where these hyper competitive environments again encourage people to engage in poor academic practice. Instructors see this in their day to day — there is a continue ‘nag’ about ‘that extra mark’ — when deep down from an educational perspective, we know that the totally of understanding is lost within the granularity, subjectivity, and pure chance of our marking systems.

In the overall system of higher education, we are forced mark because we must provide a grade, because that’s ‘how we add value’, reinforcing the circle and cheating in the embedding of knowledge, rewarding curiosity, and providing skills training.

Academic Metrics

As our students progress into research careers, they are moved from a hyper-competitive and quantitative environment, into this world which is more uncertain, and answers remain unknown.

Is everything engaged in a hyper competitive sprint? (photo from unsplash)

Assessment practice dramatically moves into a ‘good enough — not good enough culture’ for formal assessments, and meanwhile they are left with a research landscape where ideas are complex and unknown.

Researchers scrabble in the dark here, and look for ‘who to trust’. This is where citation worship comes into it’s own. Recruitment, retention, and promotion committees struggle in their evaluation evaluating the ‘quality’ of a human being with regards to the potential for them to do their wide-ranging and poorly defined job (show me an academic job description that makes sense).

These struggles lend themselves to the insertion of (false) objectivity through the use of poorly formed metrics. In essence we often find ourselves outsourcing our decisions processes to third parties, be they an improper tracking of publication records or the (societally-and-institutionally) biased use of teaching evaluations.

Especially in STEM, we are trained to ‘trust the numbers’, but we know that there remains uncertainty and context for any metric. Fundamentally, this is why we write a paper to tell a story about our observations, and we do not simply publish a table of data.

The same ‘story telling’ aspect must be true of the human beings are are evaluated via peer review, e.g. for academic fellowships, promotion and more.

Yet, we also must be aware that these stories will be tainted by the biased brushes of the environments in which we each exist. The misogyny, cis-heteronormative, ableist, and (in the global north) broadly an English-speaking white European-Colonial landscape, exists both within and outside the academic ivory tower.

Generation of the Impostor

In all of this, the impostor runs wild.

Yes, there may be literal impostors in our midst, but I would suggest these are few and far between.

Many more folk are left ‘feeling like impostors’ — i.e. paralysed by impostor syndrome, as there is too much to excel in, to much randomness, bias and chance, and not enough resource to enable people to survive on their own merits. In an absolute world — this metrics based achievement would be based upon skills given fair opportunity, but the world is fundamentally flawed due to inequity.

Linking our themes together, how do we go full circle, from a incidence of alleged cheating to the evaluation of academic skills and know-how?

Is there space to fail your way to success in our current system, or must we always feel that we have to ‘win’ to be allowed space to exist? (Photo from unsplash)

In both cases, people try to cut corners due to lack of resources, lack of focus, and lack of skill in navigation of complex systems. It is no longer felt reasonable to fail your way to achieve success, as the world moves faster than we can manage, and we do not have the courage or forsight to stand proud simply to be ourselves, and in many cases we are never given this opportunity.

This uncertainty is toxically fuelled by an unquestioned thirst to be ‘better than our peers’ (which is a peculiar phrasing if you pause to think about it). Hyper competition, and losing sight of the importance of knowledge, fair judgement, and more is enshrined at an early stage in our careers.

This starts with the academic gold-fish bowl of improper assessment in an academic ecosystem, which beings (in the UK) before University, but it is further enshrined and established as the way things are. Feedback is often distilled into simple marks that sate our self-worth, but fail to address a more wholistic understanding of our learning and development needs.

More complex feedback may be provided, but how much is that taken to heart? How much of that is translatable beyond the confines of the individual who is being evaluated, and how much of that is shared honestly with others to enhance our (individual and collective) development?

This leads us towards more ‘senior’ stages in our careers. We cheat at weighing up the competition, and ourselves, in our simple numbers, as we are never sure enough in the ‘soundness’ of our own decisions. This is driven in part by a rationale that translates as a narrative fit others, where we simplify complexity.

For example, we may weigh up individuals via the total (physical) weight of papers in our publication history, perhaps our grant income, we count our citation churn, or we peer at our our teaching evaluations. The list continues. Fundamentally, each of these metrics is distorted by the society we live in, and they are inequitable (though they can be useful, sometimes, perhaps).

Time and time again, we hear how key decisions are taken out of our hands and justified through these simple metrics. Each of which can be gamed, cheated and distorted beyond recognition, especially in the hyper competitive world in which we live.

And yet, we’ve been trained to trust the numbers, as after all, the numbers would never be impostors, right?