Yes, you can fill the glasses with hot water and make tea, coffee or any other hot drink of your choice.
PLEASE NOTE: Glass does not like extreme temperature changes and can crack. To avoid thermal shock, pour the hot water into a glass that is at room temperature rather than a chilled glass. Please also note that the glass can become very warm and you should handle it with care.