Evenly is an adverb that means calmly. I think this joke is poking at an "Eve" reference. Eve was the first woman to exist on Earth, and for awhile was the only woman to exist on Earth according to the Bible in the book of Genesis. "Eve" can be found in "evenly". 
I wouldn ' t marry you if you were the only woman on earth , said Tom evenly .