Stern Men by Elizabeth Gilbert is set primarily on two tiny islands (fictional) located twenty miles off the coast of Maine. The Prologue summarizes the history of Fort Niles and Courne Haven islands from prehistoric times. The first European population is Scots-Irish. Early in the late 19th century the Ellis family of Concord, NH, begins quarrying granite on the islands, bringing in immigrant workers.