Fixed borked URL parsing in project crawler. Improved error handling in main.py.