That would be the amygdala.
The amygdala It's located above the brain stem, in the medial temporal lob.
If bilateral damage in the amygdala occurs, it will affect the recognition of fear because its the center of this process. Basically the amygdala will send a message to other parts of the brain, saying "pay attention!"