Why did the boys feel so out of place in their new home that their father moved them to when Rick was six?

The house was big but decrepit. It was also empty. The boys heard noises on the second floor and so they were afraid to go up there. They were also afraid of their father. He had not been around for years, and they could feel that things were not right with him.