Yes, you can export virtually any data associated to a post, including categories and tags. Check out this guide how to add tags and categories column to the exported CSV file.