Only check password when changing stuff