refactoring load_data to help support scaling later (and added support for "ad hoc pathways")