Question

If there is an attractive force between all objects, why do we not feel ourselves gravitating toward massive buildings in our vicinity?

Answer 1

Because there is a far more massive nearby object that's attracting you to it. That object is the planet you're standing on. Compared to its mass, that massive building could just as well be a speck of dust or a clump of lint. The gravitational attraction toward Earth completely swamps out the attraction toward anything else.

Answer 2

The mass of an object affects how powerful the attractive force is. To feel the pull / gravitation the mass of the object would have to be huge, bigger than that of massive buildings