To marry a woman with whom one has cohabitated as a mistress, is termed, making an honest woman of her.
Definition taken from The 1811 Dictionary of the Vulgar Tongue, originally by Francis Grose.
Honest Man * Honey MoonNathan Bailey's 1736 Dictionary of canting and thieving slang
John S. Farmer's collection of canting songs and slang rhymes