Speed is helpful, but it is more important to have a deep understanding on the concepts than to have a fast working ability without understanding.
Since everything in math is interconnected, the deeper your understanding of the foundational topics you learn, the more easily you’ll understand new concepts that build upon the foundations.
As a concept, speed or rates of change are a key topic in Calculus. So speed is also important that way too.