Compare yourself more to a ghost than to a loud and bumbling creature. You should be able to disappear into the shadows in any social situation. You have to learn not how to own the room, but how to relinquish it. How to get rid of yourself entirely when it does you a favor to let everyone else indulge their vanity. You’ve observed many people become frustrated at any threat to the attention they might receive from a group. If they crave that, you’d be making a mistake trying to deprive them of it. It’s like stealing a toy from a dog. They will growl and become angry with you and many times, it won’t end well. Learn how to step out of the way.