They often face abuse at the hands of smugglers , with many forced to disembark offshore to avoid Yemeni coast guard patrols .