Ernest is experiencing the effects of loss of status following the termination.
Once he lost his job, where he was respected as a good worker, he lost that status as well. Now, he is unemployed, and even though he has enough money to sustain himself, he isn't considered part of the workforce anymore, which obviously depressed him a bit, even though he doesn't know it yet.