They produce toxins that make them poisonous. The sponge will produce toxins that could disrupt the metabolism of any organisms that dare to consume them. Most predators will be able to detect this toxin through their sense of smells which make them rather to avoid the sponge.