Check if it' s a file then source it.

If e.g. "~/.extra" is a directory this file throws an error.
This commit fixes this and only tries to source real files. Not directorys.