Caliban realized that stephano and trinculo aren't smart because they were drunk and obviously drunkards can't even bothered to do anything, and they were not even listening or taking interest when he was talking about the plan to kill Prospero. Soon caliban realized that they were just drunken idiots he was telling his plans to.