Newborn baby rabbits are usually weak. They cannot be accustomed to human touch too often. So, if you are willing to pick up baby rabbits, you should wait until they reach 3 weeks of age. Once 3 weeks have passed, they are capable of interacting with you a bit more. At this age, you can pet baby rabbits as you wish.