Refrigerator usually gets heated up during the process of cooling the air inside .  The heat is dissipated from the refrigerator which makes the sides warm and is quite normal.