Change page action title property
Apparently page actions don't need to be hidden on navigation

Source: https://developer.chrome.com/extensions/pageAction.html#ui
Everything but the icons ready to test