Shelter Island is two-and-a-half hours from New York City, and is accessible only by a seven-minute ferry ride – just enough, Cary says, “to free you from the bonds of the city.” Courtesy Architects and Artisans.