Milton and Catherine Hershey chose a site on a hill overlooking the chocolate factory for their own home. Called High Point, it was completed in 1908 and, with 22 rooms and a staff of only three, was rather modest compared to the homes of other wealthy industrialists of the age. Kitty Hershey personally oversaw the landscaping, which included many flower gardens, fountains and statues.

Sadly, the Hersheys did not have long to enjoy their new home together. Kitty died in March of 1915 after many years of a progressive illness. In 1930, Milton Hershey donated High Point to the Hershey Country Club, retaining only a small upstairs apartment in which he continued to live until his death in 1945.