There are very few disadvantages to using a buyer's agent. One potential risk: You may have to sign an exclusive buyer's agency agreement, which locks you into using that agent for a certain period of time (usually 6-12 months).
However, most agents will let you get out of a contract without penalty if you're unhappy with their service. They'd rather lose your business than risk a negative review and tarnished reputation.