paramour

a lover, especially one in a secret or illicit relationship

a woman's lover