Yes, just like you diversify your portfolio by adding both equity and bonds, diversification of bond investment is recommended as well. It will safeguard you from non-systematic risks. Spread your portfolio across bonds with different ratings, different maturity dates, etc.