They won't get half as much pleasure stuck off alone with something you don't like well enough to share, and you really won't want to be left out of the fun either. Trust your own reactions. Of course, tastes and interests vary as much for children's books as they do for adult books. It's useful to remember that every book doesn't have to do everything, and it's not the end of the world if a promising title flops. There are always other books to be shared, and there's always more to learn in the process.
Reading can be the same kind of shared activity as fishing, playing cards, or going to a concert.
Your response to a children's book, linked with your involvement with the child, is as important as any expert's recommendation.