There is nothing wrong with judging people primarily on their physical prowess - we do this all the time in competitive sport, where fitness and strength are major determinants of success. Moreover doing so is little different from judging people on non-physical qualities such as intellect. Every competition, of every kind, values certain qualities over others - we recognise that being able to lift heavy weights isn’t the prime definition of human worth, but we can still give prizes for weightlifting; similarly, we can give a prize to a beautiful woman for her beauty without implying that beauty is all that matters about anyone.