The way it is done may be different, but it still needs to be done. Cleaning a window is a common chore. While floating, cleaning it in space has to be done with a different approach. Astronauts do get one break. There are no washers or driers in space.
Dirty laundry is saved for when the astronauts return back to Earth.
Keeping everything else clean keeps astronauts very busy. Disposable plastic gloves are worn while using the cleanser. General-purpose wipes are used to wipe dry areas being cleaned. Silverware, trays, floors, and walls are sometimes wiped cleaned. There is good news and bad news when it comes to washing dishes.