A mistress was a high society woman, while
people used to call master the men, they would also call mistress the women, so in this
sonnet, he talks about his loved one as a
woman with class and grace not a woman
with a dubious reputation as we would think
at first.