Removed task and people from multiselect/show all/dropdown list

Is there a way to do this more generically or robustly? This seems pretty "special case" to me.