This appears to be a wind-related issue. We would recommend a specialized, high-wind cap to replace your existing chimney cap. We can make a recommendation if you provide the inside and outside diameter of the chimney at the top.