Only try to remove temp files if directory exists.

`glob()` returns false if the directory doesn't exist which causes
warnings when running this.  We only need to run it if the directory
exists.
Add a docker/fig based build.