There are many ways to do it. For windows that are extremely grimy, you can use vinegar or a grease-fighting dish soap like Dawn.