Yes and no! Essentially, they are stainless steel so will be fine in hot soups and stews and potatoes to make puree. Most have at least a 7-inch shaft so that you can get to the bottom of your pan.
Not all manufacturers advertise their immersion blenders to be used in hot food because of the possible safety issues. They might be concerned that the user will get splashed and burned.