By then I would say either the British or Dutch. More so the Dutch because New York was originally founded by the Dutch and was originally named "New Amsterdam" after the capital of by the time (I believe) to be Holland, modern-day Netherlands. Otherwise the British flooded New England, after all, it is called New...England so...