We walked right into Hallgrimskirkja. But this is probably different when there is a service of course.