Answer:
Someone on their phone may be distracted and wander into traffic, posing a risk to both the pedestrian and driver.
Additionally, someone on their phone may be walking slower, slowing down foot traffic. This would likely also slow down the pedestrian's time crossing the street, slowing down traffic trying to get through an intersection.
(I am not a primary source, you may want to find scientific data)