Simplify FlowTaskManager

Thanks @thehutch!