A good rule of thumb is to give them five minutes of exercise per month of age, up to two times per day until they're fully grown at about one-year-old.
Giving them some play will be good for them as long as you don't overdo it. Make sure not to take puppies out right after eating, as it can make them bloated.