Updated get_subject_urls to actually hit the website instead of using local copy