You can, although I love the soft texture of the French bread. If you decide on crackers, get a mild version (like water crackers) so the cheese and the jam can take center stage.