It is. Popularity with men is more useful though.

Girls are to be admired. It's probably better to love them rather than be loved by them. They also say women betray, but men do not. [In the more colloquial, bonding sense anyway]

The point is there's not as much loss if you don't have popularity with women.