All this stuff should really be in the view controller TBH. You aren;t gaining anything by placing the layout in a custom view like this. I would however make a UIView subclass (or UIButton subclass) for the calculator buttons themselves.

But for now I would move all the code here to the view controller. That way you can interact with the model layer without breaking mvc.