Rhetorical Devices are techniques or language used to convey a point or convince an audience. Rhetorical devices are just as useful in writing as they are in the real life.
James Baldwin says "It began to seem that the machinery of the organization I worked for was turning over". Clearly, he doesn't mean it literally, hence the word "seem" in the sentence.
Therefore, we can conclude that he is using Figurative Language.