Sit-ups can be effective for building core strength but should not be the sole exercise for core training. They primarily target the abdominal muscles but can put unnecessary strain on the neck and lower back if not done correctly. Incorporating a variety of core exercises is recommended for a well-rounded core strength training program.