Why was Uncle Lucious absent during Margo's early life as noted in the memoir, Negroland?

Uncle Lucious, who worked as a salesman, was absent during Margo's early years because he lived his life as a white man, and he never spent time with members of the family unless they could also pass for white. When he retired, Uncle Lucious returned to Negroland and took up his life as a Negro.