Yes, you can--but it's not recommended. Ideally, if you're going to clean records, you should use a proper record cleaning solution or a homemade solution that contains distilled water, one or two drops of regular dish soap, and one or two drops of isopropyl alcohol. If you're absolutely determined to use Windex to clean your vinyl records, just make sure to rinse off the record with distilled water immediately after you finish cleaning your album.