Cakes actually thaw rather quickly, so you don't have to worry too much. Even in the fridge, the cake will continue to thaw, so by the time you add the ganache layers, it should be good to go—er, serve!