CLN: remove special casing of object dtype since we disallow it