The more you move it, the higher the pressure it places on the arrow. When it clicks, the arrow may spring outwards. My advice to anyone is to buy a bow on feel. Agree with this. Some people have better grouping with one bow and not the other.
Looks are quite important.
If you are going to shoot it couple of times a week for a few years, may as well have a handsome bow to live with rather than an uuugggglllllyyyyy one. You may not be having any problem with your current setup. This in change will increase the pressure put on the arrow. Just like when you bend a plastic ruler. The more you bend it, the higher the pressure.