vm: pte: Remove some redundant code

Signed-off-by: Bart Kuivenhoven <bemkuivenhoven@gmail.com>