sbrk02: check for ret code in setup()

In the case sbrk() doesn't return ENOMEM, setup()
keeps looping forever.

Modify setup to check sbrk() return value and also to watch
if increment doesn't overflow.

Signed-off-by: Jan Stancek <jstancek@redhat.com>