Only redraw when there are less items and append new items to prevent flickering