When a task has been archived, it will appear as "archived" (or "closed" for Guests) in the sidebar task list for a period of 30 days. After this period has expired, the task will no longer be visible to the Guest.
Please note however, archived tasks will always be visible & accessible via the "archive" tab on the project board.