It’s fine. I'd maybe tell people that you have an ~exclusive~ genital preference to be super duper clear. Since you don't care about gender, people may think that when you say preference you don't mean "exclusively this" and instead mean... well, what the word says - that you prefer one over the other, but would take the nonpreffered option.