Fix a lot of logic errors in CollisionSet (Was I tired when I made this or something?)