Why is it strange that Yugiri has tried to seduce the Second Princess?

Yugiri has always been presented as an upstanding young man, who is unlike his seductive father, Genji. Yugiri, unlike his father, has never had an affair in all his life, but he believes that he is in love with the Second Princess.