Add a test to verify an app is listed on Settings->App permissions

Addresses #1325