Revert "Also add optional icu4c support"

This reverts commit f1f163b09b374481bbfd5642922ad5cb0c50df7e.