He is stealing things he wants.
Huck clarified in Chapter 12 that his father had a philosophy of “borrowing” which was taking an object from its owner with the intention to return it in the future. However, the widow told Huck that borrowing is a subtle version of stealing.