Yes, they brought their horses with them when they crushed the atlantic.
One of the reasons was: Their intrinsic effectiveness was linked to the fact of the surprise and the fright that it caused, since, the natives thought, sometimes, that rider and horse formed one being, and others, who were immortal.
This helped the Spaniards in their battles and in the subjugation of the natives.