The main sign that your website has been penalized in some way by Google is when you see that your day to day traffic had a massive decline and never recovers. You can also check ranking tools to see if you received big declines across the board for your most important, previously high ranking, keywords. Lastly, you can look in your Google Search Console account to see if you have any manual penalties assigned to your site.