Simplify merging while making sure we dont effect existing objects

Fixes a bug where instantiated objects aren't properly cloned.