No, please don’t do that. Let go of the breath completely, as this will help you to get deeper into the meditation. You observe the feeling of Loving-kindness.
Later on you won’t even notice the breath.
Just apply the 6R’s whenever your mind goes to the breath. Stay with only the feeling.