Essentially, it's a belief that's largely different from a widespread or established belief. For example, a belief in Toaism or Sikhism would be considered heresy in a place like Early to Middle Age England, where there was the established Catholic Church.