Only listen to change events when necessary