Use public notifications feature on Android 5

Follow up to #1341
@garvankeeley is this working for you?