This question is asking about the Pythagorean Theorem (A^2 + B^2 = C^2)
You know the length of the hypotenuse (this is 12 feet, the length of the ladder, which is C), you also know A, 3 feet from the side of the house.
So we have to plug into the formula what we know 3^2 + B^2 = 12^2, or 9 + B^2 = 144. By rearranging the formula you get 144 - 9 = B^2. Once you solve for B^2 you can take the square root to get B. (It's 11.6!)