The problems are designed to solidify your understanding of the theory. If you find yourself struggling because of weakness in algebra or calculus, that is not a problem with the physics. You should review the math. Remember, you can't build a house without the correct tools and you can't expect to understand physical concepts without the correct tools either. Math is just one of the tools you will need.
Physics encompasses a broad range of concepts, ideas, problems, and solutions.
When physics is applied to the study of the cosmos, it becomes astronomy or astrophysics. When physics is applied to the study of matter, it becomes chemistry. When physics is applied to the study of the Earth itself, it becomes geology. Engineers must also have a solid background in physics because engineering is merely applied physics. Medical schools like to see applicants who major in physics because is means that the applicant has good problem solving skills.