There you go again. Newton's 3rd Law says "for every action there is an EQUAL OPPOSITE reaction.".
EQUAL and OPPOSITE
If THIS MUCH force pushes the bullet THAT way, then THE SAME amount of force pushes the rifle THIS way.
The bullet pushes backward on the rifle with the same amount of force as the rifle exerts on the bullet.