Yes you can — but only once you have taken the proper precautions and ensured that whatever load they are bearing can be supported in another way. Load bearing walls play an important structural role in the construction of a house.