Because Lord Walder Frey was an evil cold man who kept spite, he had no remorse for killing Robb, his guest, and King. Upon killing him, he violated the guests' rights.