This can be generalized: with isolation, people don't have contact with others, so they can't spread the religion. Because the monks were so isolated, the general population was less involved and didn't find out about the religion as much and people abandoned it and new people didn't join.