If there were no air, the object would be in free fall the entire time, and there would be no "terminal velocity". So, the object is closest to being in free fall when the effects of the air are minimized--and that is when the object has the smallest speed relative to the air.