It depends how you use it. Neighbors without an apostrophe is just referring to two or more neighbors as a subject, but if the apostrophe is used before the s, one neighbor is in possession of something. If you are trying to say that more than one neighbor owns something, you would put the apostrophe after the s.