Robert Carmichael is the eldest child of William Howland and Margaret Carmichael Howland. He is one of three siblings and their only son. He has two younger sisters, Nina and Christine. In addition to his sisters, he was raised alongside his father's granddaughter, Abigail. Robert's parents came from very different backgrounds. William was descended from a wealthy family. The Howlands were influential and provided the cornerstone for the local economy. Margaret was from a less fortunate family that hardly missed her when she left.