If he had died old, he would have taken over when Tobirama Died, as Hiruzen did when Minato died, but instead tobirama left hiruzen in power after his death.. he had to have died some time before then. He probably sacraficed himself at some point as this seems like the pattern. .. the possibilities are endless, but untill kishi says something, we will never know.