I'm not saying you should ban mosques but when they do the whole call to prayer thing at 2am, I understand. Guessing you've never had to sleep any extended period of time near a mosque. If church bells rudely woke me up at 2am I'd understand the church banners too.
It's a numbers game as to why, not an argument being raped isn't worse. Relatively fewer people have been raped by a priest. Easily 100+x have been sent into a rage by the fucking call to prayer at 120 decibels. People tend to get more upset about things they have actually experienced.