Why can't the hermit cross the pond to get to the camp?

I believe you're referring to Christopher Knight in Chapter One? If so, he initially planned to cross the frozen pond on foot. The temperature, however, had warmed up enough that crossing the pond would be too dangerous. Thus, he decided to go the long way through the woods.