Ideally, they should be tethered to the ground. The grounding cable that comes with the Blocsilver Shielding Canopies, which I've recommended in this post, serves precisely this purpose.
You can plug one end into the wall socket and the other end into your crocodile clip. If you intend to use these canopies, you should ground them if at all possible, even if they don't need them.