Preserve grouping only if have grouping vars

Otherwise silently down cast to tbl_df. Closes #733.