Use removeChild for element removal when not in IE for better performance and to fix svg issue, fixes #14