Can a toddler drink tea?

I drink a lot of tea, and my toddler likes to have occasional sips. I make plain, decaf tea, nothing fancy, no green tea, no herbs, etc. just normal teabag tea. I barely sweeten it too, one packet of sweetener lasts me 3 glasses of tea (so almost unsweetened). Is there any issuse with giving a toddler (20 month) more than a few sips?