If a married man has an affair, it may not be with a woman