Removes NSView references from CALayer