The Golgi apparatus “modifies, sorts, and packages different substances for secretion out of the cell, or for use within the cell.” This organelle would get most affected because the toxin would not only disrupt protein transport but also modification.
Hope this helped!