Katniss says this of Peeta because she is beginning to realize that she has feelings for him and it is easier to dislike him and to view him as the enemy when he's being irritating. And, at this point in the story, she believes that there can be only one winner. If it comes down to her or Peeta, she's not sure she could kill him.