Doing some more sanity checks in case we're loading an entire directory

Signed-off-by: Toon Schoenmakers <nighteyes1993@gmail.com>