I recommend making this trifle the day before you want to serve it. Any shorter and it might not firm up in time, any longer and it could go soggy. The jelly and custard could both be made two days ahead of time if you want to get ahead, then assembled with the other ingredients the night before serving.