People forget that black men, many of whom were born slaves, got the right to vote before women.