Remove a now-unneeded leaf->species map