They were known as Burghers
These were workers for the Dutch trading company that had a post there and they were allowed to get land and do farming and live there and in exchange they'd have to give some of their produce. The settlement started rapidly growing as more and more people started settling and it became a really big society in no time.