Yes, you can. Trifle tastes even better if it's made up to a day in advance because it allows all the flavors to marry well. Assemble all the layers, except for the whipped cream and final toppings; and refrigerate till ready to serve. Top with whipped cream and nuts just before serving.