I now used the beautifulsoup library to get the download links from the pages