Answer: Rephrase the sentence with more formal grammar:
We will knock the old library down.
The old library will be knocked down.
Explanation: Move the direct object of the Active sentence to be the subject of the Passive voice sentence. Change the main verb to its past participle form. Add a form of the verb "be" as an auxiliary.