In Hogwarts Legacy, to get to Azkaban you'll need to finish a side quest that's only open to Hufflepuffs – and not Gryffindor, Ravenclaw, or Slytherin.