I feel like a common misconception is that the warlock is drawing power from their patron like a cleric. They're not, that power is theirs, and the patron can't “cut them off” from their spells.