Yes, you are absolutely correct! Allow me is simply a more formal version of let me.
Ex: Allow me to lead the way. = formal
Ex: Let me lead the way. = more casual