Since you didn’t ask your joiner to prime the door you could ask him to fit another door and withhold payment until he does.
Alternatively, you’ll have to give the primer a few days to fully cure and then remove it with fine sandpaper. This isn’t going to be an easy job but it’s the only method that will work.