For answering this question,let us assume that a person is pushing against the walls,so now:
Which object exerts the action force?
Which object exerts the reaction force?
In what direction does the action force push?
In what direction does the reaction force push?
The answer varies from different scenarios.