Remove dependency on Shapely

cc @keflavich - add any useful info you find here.