I think it is because in Christianity God is father to all men because he created the world (and in that sense "fathered" the world), so in this case, he created you, so you are a part of him, and he is considered a male, so you call him father. I also think that this is not recognized by non-Christians probably because they are just not Christian.