Deffer sortable init to as late as possible, fix removing items