What about Elyot's behavior annoys Victor?

Victor becomes extremely irritated with what he sees as flippancy on Elyot's part. Elyot prefers to run away rather than deal with the situation and does not wish to take anything Victor and Sibyl say seriously. Worse, he makes light of Sibyl's extreme distress over being abandoned.