I have no problem with Muslims. But I have a problem with their way of "fighting" against our way of living.  I have a problem with the fact that even a "secular" Muslim will pick a fit when his/her son/daughter gets involved with a Christian (or Jew, or Buddhist)... I have a problem with asking for special accomodations to allow him/her to pray while at work. Even if Coran allows not to pray in special conditions. Or with the fact that they do not adapt our culture and want to impose theirs - no music classes, no mixed swimming classes.
It is absolutely clear that the "others" will start pushing back - if he is allowed to pray 5 times a day, why cannot I refuse coming a Sunday to work because I have church? Or not work on Fridays because I am Jewish? The "when in Rome do like the romans do" doesn't seem to apply to SOME of the Muslim community.
Unfortunately, even if the MAJORITY of Muslims are good people, the FEW "bad" Muslims are going to make the front pages. With all the fallout.