Filter out invalid time histogram keys