When Hester delivers gloves to the governor, what is the other reason for her going there?

Hester goes to the governor's also to seek an audience with people in power to help Pearl. She--and the governor/officials--are concerned about Pearl's moral well being and whether or not the child will grow up to be evil or good. The governor and other male officials think that perhaps Pearl should be removed from Hester's custody.