My (27f) boyfriend (30m) gets a lot of attention

My boyfriend is a conventionally attractive man and we live in a small town which seems to make this a bigger deal than I had expected. He is always getting attention everywhere we go. Girls and men go out of their way to let him know they’re interested. I will clearly be at the bar with him, kissing on each other, then go to the bathroom and a girl will swoop in asking for name and number. I’ve had girls ask the bartender for his name, etc. His reaction is always good. He always tells them he’s not interested, and has a girlfriend. He comes to find me and tells me immediately. But I can’t help but get my whole mood spoiled. I get annoyed, frustrated. I wish people would respect us. I get insecure, and my confidence is shot. I usually think I wish I was with a less attractive person. For less attention. How do I get over it?