Who is the antagonist in the novel, Mystic River?

In the end, we learn that Ray, Brendan's younger brother, murdered Katie because he didn't want to see his brother move away.