Implement missing pieces for cancel build

We allow to cancel only created builds at this point.