Use IntObjectHashMap per @trustin's suggestion