Yes, if the Home Office deem your accommodation unfit or unsuitable for your family, your application may be refused.