Overall, political science is not impossible — but it has its challenges like any discipline. I would not focus as much on whether it is difficult, but instead whether you think you want to learn more about ideologies, conflict and the institutions to manage them.