This is subjective and can vary from person to person. Both physics and chemistry are challenging in their own ways. Physics requires a strong understanding of mathematical concepts and the ability to visualize abstract concepts. Chemistry requires memorization of complex chemical reactions and an understanding of how molecules interact. Ultimately, the level of difficulty depends on your strengths and interests.