We need to exit the context after cuda calls.