Add null context if inferences are contained within the default graph.

Change-Id: I43f262bd95d4dad9743bb32267d8bc0a8dcccc75