You can, but you don’t have to - choosing generic, all-purpose cleaning sprays that are suitable for the whole house will be a cheaper option.
An all-purpose cleaning spray can clean the surfaces in your kitchen and bathroom, whereas glass cleaners leave a streak-free finish on glass and mirrored surfaces, like your windows, shower or living room tables.