The easiest way of removing rust from linoleum is not having any at all! Keep wet coats, shoes, clothes, etc. away from linoleum flooring. Regularly clean the linoleum with appropriate finish or treatment.