Over the years, I've tested hundreds of network-related computer products and built a series of test labs around the country for various clients and publications. I guess I thrive on looking at the new, the unfinished, the latest beta. Many of you have asked me for advice on setting up your own lab, and so let me share a few secrets and a few products that can help.
Any lab is an artificial world.
A good lab can mimic what eventual customers are doing and demonstrate some of these end-user issues. Second, don't get hung up on testing performance. While it is nice to offer the fastest product, everyone has his or her own definition. Best to skip performance issues if you can, or at least come back to them later when you really understand the interactions with other products. Finally, get the proper tools to make it easier to set up and tear down tests.