If the tall rectangular block of Orsanmichele looks to you more like a grain silo than the church it's supposed to be, that's because it has been used as both.
The Orsanmichele may remind you of a grain silo because it was used as both a church and grain storage.