No. By removing yourself from a group chat, you'll no longer be able to get new messages, but the old conversation will still be on your chat list unless you want to delete it.