Mr. Castro temporarily handed power to his younger brother , Defense Minister Raul Castro , due to the operation .