added some preprocessing to reduce number of results passed in for normalisation