St Augustine, FL. Spain established several small outposts in Florida. The most important, St. Augustine, Florida, founded in 1565, was repeatedly attacked and burned, but was the first permanent European settlement in what is now the continental United States.