Like with most custard-based dishes, if you over-cook the brulee it would curdle and make the texture unpleasant and not smooth. The flavor may still be intact but it won't have the smooth decadent texture we love with brulee.