Optimize toObject() impl
Remove the change tracking