You should always use cache. The only case when you don’t need a third party caching plugin is when your hosting provides page and file caching. If you’re using an automated WordPress hosting platform like 10Web, you don’t have to worry about server-level caching. Caching is handled for you automatically.