I don't think it was Symbolic, it is told that they first face Jerusalem when they did prayer, Then God sent a command that they should face the Kaabah which was built. this is why u see Muslims facing towards the Kaabah during there Prayers. if this is what ur talking about then this is the answer