No physics needed!

Now this one was a bitch. Since when I couldn't see them, I would run into them randomly, but when  could see them, nothing was randomly in your way. I ran some tests and confirmed this guy was the issue. So, here is the fix I have that works!