Dally might have stare at Johnny because he said the her to stop bothering the girls. It seems that he was not always like this with her and this caught her attention. If somebody else would have spoken to her like that she would not have let him / her get away with that tone. it is the first time Johnny stands up to Dally.