Hey guys, there is such a thing as Freedom of Association which makes this type of event perfectly fair. This is a private group and if they want it to be women-only then they have every god given right to make it that way.
There is nothing stopping you from forming your own men-only group.
What if they only wnated to associate with white people?