This is due to friction as fibers can break over time. These broken and loose fibers will then clump together to form little balls.