Some libertarians would say that such are not "true" libertarians, but of course that gets into the murky territory of who gets to define a movement (and no true Scotsman fallacies).
At best, libertarians who are pro transgender rights on a personal level, feel that it's desirable for people to be allowed to discriminate at a private level, and some dodge the choice bullet by saying that they think it should be "up to the states" to decide if abortion should be legal in their jurisdiction. Why it's palatable to have one's freedom restricted by an overbearing state government but not the feds, I have no idea. That comes off (to me) more as traditional conservative (states rights and strong local government with a weak federal one) than libertarian (as few government restrictions as possible).
I am not, and never will be, libertarian because I don't see any historical evidence that people will grow up and start treating one another with respect or start chipping in to pay for things I consider good and valuable (things that are too expensive for most people to buy for just themselves) without taxes, laws, and government. We have had some pretty amazing things that are funded in whole or in part by taxpayer money in the US--national and state parks, universities, public broadcasting networks, arts and science, NASA etc. I want to live in a civilization, darn it, and civilizations take compromise and shared purpose via government.
We also, imo, need a strong central government and laws restricting the right of those in the majority to discriminate against those in the minority (or those who have traditionally been disenfranchised).