i think the main reason dally go into the church for the kids but didn't go in for Jhonny is : Guilt
The feeling for compassion took over dally's consciousness that lead dally to rescue the kids.
Dally has a past regrets similar to this and does not want to be responsible for anymore death