You can stop at any point in the relationship. Some couples don't even talk about it, it just happens. I think it's safer to stop when you've both taken a full medical inspection. A medical exam is an important part of the relationship process for me and must be done regularly. It makes your experience safer and increases trust. If you're on any birth control methods, that's a good cue to drop the latex, after a medical exam.