Make sure the path exists when merging