CLN: cleaned up _try_cast in core/groupby.py to eliminate cruft
Merge pull request #3934 from jreback/GH3920

CLN: cleaned up _try_cast in core/groupby.py to eliminate cruft (GH3920)