Graphing: Fix for graph grouping not clearing when removed