Fix import restrictions

I am not happy with the way that we track importability for external
crates