Small updates based on feedback

1) Tell devs to remove comments
2) Explain that PR needs to be deployed after merge, it won't be live
immediately

//cc @zekiel @mwmiller @mintsoft