Sugar Loaf, NY Category Chester, Churches, Locations, Main Street, Neighborhoods, Railroads, Sugar Loaf Description Sugar Loaf is a hamlet in the town of Chester NY.