Fix race in user*Handler destruction

Summary: Closes #3329

Reviewed By: @ptarjan

Differential Revision: D1546084