Some species, particularly humans of Thomas' era, believe that those in relationships should have sex only with the people they're in the relationship with. To do otherwise would be...dishonest? Hmmm, perhaps inappropriate would be a better word.

Or perhaps he thinks that his sleeping with other people would be unfair to you because he should have to hold himself to the same standard he's asking you to?