BUG/TST: groupby with mixed string/int grouper failing in python3 (GH6212)

closes #6212