Fix findbugs finding: Field only ever set to null

All other uses of the field were to check if it was null,
which it was, so it was removed