Yes in moderation tea / coffee is fine. However milk and sugar add unnecessary fat and calories, so try and use sweeteners or skimmed milks. Ideally black with no sugar if you are that brave :)

Herbal teas on the other hand are great and a good way to meet your water allowance