For what reason did Graham believe that his sister hated him in the novel, Weyward?

Graham believed all of his life that Violet hated him because their mother had died giving birth to him. When Violet and Graham were staying together at Weyward Cottage, however, Violet assured him that he was not responsible for his mother’s death.