Through his grandmother Mary Rice, Edgar was descended from Edmund Rice, one of the English Puritans who moved to Massachusetts in the early colonial period. He once remarked "I can trace my ancestry back to Deacon Edmund Rice, ." The Burroughs side of the family was also of English origins and also emigrated to Massachusetts at around the same time. Many of his ancestors fought in the American Revolution.