Yes and no. When a private message is deleted, the sender and receiver won’t be able to see it. However, Discord’s servers will keep a copy, which might be discoverable if a court orders the company to surrender them.