Remove utils/fixes and add another sklearn dependency to reduce duplicated code.