Should I tell her how I feel ...?

It is not fare to you to tease and flirt with you in that way, yes discuss it with her, but first be a man and take care of the relationship you are in now, sex is a very important in a relationship, one person who loves lots of sex and the other who does not, just will not work, you have some decisions to make, good luck.