Water glasses are often cleaned with glass cleaner rather than actual soap and water; glass cleaner is known to be toxic when consumed by humans. Depending on the hotel, water glasses and mugs might not be cleaned between guests at all. If you have to use the glasses provided in your room, make sure to wash them thoroughly (with bottled water, if you want to be extra cautious) before using.