What are the potential drawbacks of using the merge sort algorithm? How can they be mitigated or avoided?