Dear Kyle,
The important thing about being a libertarian is not wanting freedom from everything all the time, but thinking hard about how to maximise freedom when people's rights butt up against each other.
Being able to claim that you are whatever sex you like, and denying biological reality when it comes to sports, gender specific spaces, and choosing your partner... that violates other peoples rights, not to mention the right to observe the world and point out the obvious.
People are tired of pretending that black is white for fear of offending someone, there are two sexes and they are a biological reality.
David