A prefix is an addition to the beginning of a word so a suffix must mean an addition to the end of the word.
If you look, fort is not at the end of the word, neither is comfort. Able is the only addition to the end of the word. If you took it off comfort is still a word. Therefore able is the suffix in comfortable.
ABLE