Locking down vehicle controller to user context