Yes, you can delete chat in roll 20. To do so, click the "x" next to the chat you want to delete.