I would like to point out that the manga said that Minato and the raikage fought several times, and A said he thought Minato could never be beaten. If you don't think that A increased his speed at all over time then you are mistaken.