If we remove heat the temperature will become lower. Higher temperatures mean that the molecules are moving, vibrating and rotating with more energy. If we take two objects which have the same temperature and bring them into contact, there will be no overall transfer of energy between them because the average energies of the particles in each object are the same. But if the temperature of one object is higher than that of the other object, there will be a transfer of energy from the hotter to the colder object until both objects reach the same temperature. Temperature is not energy, but a measure of it.
Heat is energy.