If the running belt is properly sized and adjusted, then it shouldn’t bounce, especially if it is designed correctly and made well. You should also wear it higher on your waist so that your core can support the weight of the belt instead of your hips.
If you keep size, adjustment, design, material, and quality all in mind, then your belt will fit perfectly and you won’t have a problem with bounce.