Kenya Barris labels his divorce the toughest thing in his life