Baby rabbits typically start transitioning from milk to solid foods around three to four weeks of age. At this time, you can introduce hay, pellets, and water while gradually decreasing milk feeding frequency until they are fully weaned.