The literal meaning of the quote is: People have seen mysterious figures walking in the moors.
The narrator claims that he has heard about people who live in the moors and have seen two figures —such a pair— wandering arround and haunting, although they cannot specifically identify what they are, so they call them "wandering spirits".