There can be different reasons for this problem. For example, if you are not using the correct ones to withstand loads of your application. If you use the thicker and bigger ones, it may solve your problem. Also, your attachment technique can be wrong. The use of riveting guns will also affect the structural integrity of your fastening. Checking your gun also will serve very well for you.