Here's a great article by Serious eats on the history of banana pudding. In a nutshell: In the 1890's, it was popular layered with sponge cake, then later on with lady fingers. At some point, many added a meringue topping. In the 1920's, the pudding was married with vanilla wafers - still popular to this day. By the 1950's, it became a southern icon.