How does Allie react when Charlie refers to the migrant workers' home as the Monkey House?

Even though Allie calls the migrant workers savages, he becomes angry when Charlie refers to their home as the Monkey House. He threatens to beat him over it. Allie probably does not like the fact that Charlie picked up the term from other children since he shelters him from them.