Yes, keeping a bucket of cold water in a windowless room will cool down the air inside it. It will also humidify the room as the water gradually evaporates. Just make sure to leave the bucket open for complete effectiveness.