Why is Mr. Rosier uncomfortable when he runs into Isabel at the museum in the novel, Mrs. Osmond?

Mr. Rosier is uncomfortable when he runs into Isabel at the museum, as her husband recently rejected his offer for Pansy’s hand in marriage.