Berenson's maternal grandmother was the fashion designer Elsa Schiaparelli. Her younger sister, Berinthia, became a model, actress, and photographer, and was known as Berry Berenson.