Yes, you can install an exhaust fan in a bathroom without a window. Exhaust fans are designed to remove moisture and odors from enclosed spaces, making them suitable for windowless bathrooms.