Release old markers to GC when they are cleared