Fixed issue where polling request handlers were not being stopped even after user calls stop

#1792