All of them?  Maybe not.  I was having trouble getting tests to run and I updated the gems which were causing breakage on my system.  I figured at that point that it was probably worth bumping them all to the latest versions.