When Edwin and Garvey leave the island, Cole admits that the last time they left he felt anger... how is this time different?

Cole admits that the first time he was left on the island, he felt nothing but anger. This time, however, the anger has been replaced by fear.

Standing alone on the shoreline, he couldn’t help but remember how angry he had been the last time he watched the skiff leave. This time he felt only fear, and he admitted it.