Milkweeds – even Common Milkweed, which blooms earlier – are slow to emerge in spring.  Most likely your Whorled Milkweed is fine and will emerge by late May.