Why is Charlie so understanding about the hostile attitude that his friends at the bakery have towards him as his intelligence is raised?

Charlie is patient with the treatment he gets from his friends at the bakery because he understands why they are so confused by him. He has never told them about the surgery, and he sees why they would be so alarmed to see his rapid progression.