James Van Der Zee was born in Lenox to highly cultured parents who had worked as household servants to President Ulysses S. Grant in New York City.