These words are examples of spatial signal words. This means that they indicate location or direction. A way to distinguish them from other signal words is to think that they answer to the question "where?".
Other spatial signal words could be:
above, in front of, aroound, between, on, in, out, far, etc.