Why does Sem tell his doctor that he longer wants to take his medicine in the novel, My Heart?

When Sem realizes that his medication is affecting his memory, he tells his doctor he no longer wants to take it.