Check that all .graph files listed in one of the GRAPHFILES actually exist

We currently check that all the actual .graph files exist in one of the
GRAPHFILES, it makes sense to check this as well.