Fix #1679 by cleaning up the latest markers
Address review feedback
Merge pull request #1746 from NuGet/anurse/1679-cleanuplatestmarker

Fix #1679 by cleaning up the latest markers