Cleaned up perfbackend/sgdbackend/backend divide.