Why does Hester stay in town after she is released from jail in Chapter 5?

Hester decides that she deserves to stay in the same place where she committed her sin. She does this in order to be punished appropriately and redeem herself.