clean up wpi weights extraction

subset data for shannon index calculations