If you say, "Had gone," that is the past perfect tense. How are those two tenses different? While the normal past tense says that the action happened at that time in the past, the past perfect tense says that the action happened before that time in the past.