Fix permission and display check on party data panel

Fixes #2203