Optimize Lookup .indexOfKey(), since we use this every remove()