Yes, the seller can refuse an FHA loan offer from a home buyer. You may decline an offer that does not meet your needs or expectations. Housing discrimination, on the other hand, is prohibited by law. FHA loans are similar to regular mortgages. .