Yes, the referee should.
In penalty kick situation, the attacking team could kick the ball that bounced by the goalkeepers in order to create a goal.
To make the penalty process became more balanced, the attacker's team members are not allowed to enter a box before the kick's taken.