no need to check if work or delayed work is pending

Change-Id: I09790b29372f5f996a539854d3e2ae8d3d7de704
Signed-off-by: Eyal Salomon <esalomon@mellanox.com>