The spoiler has no base since in the manga Mifune said:Hanzo-Dono I presume.I wish to face you in battle.So it's not possible for them to have faced each other off in the past.