overflow bug in multi-index when checking for duplicates

closes https://github.com/pydata/pandas/issues/9075