We will have the following:
The correct answer is vertically.
The way to understand that is to image the pulse an instant later. The wave will have moved a bit to the right. Therefore, since the particle is still on the wav, and can only move up or down, it must be lower.