1) Let's start by grouping this polynomial
2) Now, let's find the GCD from x³, 5x² and on the second parentheses, 16,80 and write it as a factor, placing the GCD of each group outside the parentheses:
GCD x³, 5x² = x² and the GCD of 16, 80 = 16
3) As we can see there is a repetition, of terms let's rewrite it this way and factorize x²-16 reminding that a²-b² = (a+b)(a-b)
So x³-5x²-16x +80 factored into its simplest form is (x-5)(x+4)(x-4)