Allow app_id to be configurable on per request

Sticking to the original API