Remove remaining numpy dependencies