I think that's true of MacVim on OS X, because of the way the environment is initialized. I'm not sure if that's specific to OS X or MacVim. Running `vim` from Terminal picks up the environment exported from the shell, so any config file is fine for terminal vim.