Make libdir and srcdir if they don't exist
Fix some bugs with builds being over-eager