Yes, you can use different types of bread, such as brioche or challah instead of hot cross buns. The bread you choose will affect the taste and texture of the dish.