Check for valid virtual address while flushing