An island of five square miles that is just east of Long Island, New York has been owned by a single family since 1639.