PermissionManager: improve loading speed and UI

Change-Id: Ia2c5767223435967b7c962cf75bc6dfb984bafd2