Its better and safer to only use the container - and anyone that knows enough to think that building outside a container is ok, will also know how to do it by reading the Dockerfile.

(otherwise, when the build becomes more complicated, users have unexpected failures, or worse successful but erroneous successes)