Unmemoize typecasted attribute values only if setting a new value