Add the tea bags into two mugs and top with 1/2 cup water each. Steep for at least 3 minutes.
Froth the oat milk in a frother*.
Remove the tea bags and squeeze them to release any extra tea. Stir in 1 teaspoon maple syrup and 1/8 teaspoon vanilla into each mug. Top with the frothed oat milk.