Don't allow filtering by user in summary mode and vice versa. It's just confusing.