Yes, the maximum player limit for dungeons is 4 players. However, you can also go with Companions to fill the needed space if you can't find an additional member in the Dungeon Finder or your group.