It's very disrespectful. You are telling them you don't respect them, even on a human level. You could send them a brief text to let them know you aren't interested, but you didn't do that. Instead, you opted to disappear without an explanation. Nobody does that to a person they respect.