Why could Jimmy be seen as downtrodden?

Basically in Jimmy's eyes rich people remain stupid and blind to society's needs even though they are offered a privileged education. In contrast, he has not had such privileges, and because of this, and despite his obvious intelligence, he does not have the same opportunities open to him.