It will definitely be harder, and the number of lenders will be much more limited, tut there are lenders available who specialize in providing unsecured loans to borrowers with fair or poor credit. An example is OppLoans.
While there are unsecured loans available for borrowers with fair or poor credit, the loan amounts available are typically smaller. You should also expect to pay significantly higher interest than you would if your credit was average for better.