One way you can them is by using a pencil eraser — yes, you heard correctly.
Rub the eraser over the marks, and they should begin lifting off the floor. If there are still signs of the marks, try to spray the area with a vinegar and water solution. Wipe away the solution immediately with a cloth and repeat if necessary.