If the witness testified to what your attorney felt he needed to hear, then your attorney may have felt there was no further need to stay.
I have had an attorney leave a deposition when all their client is concerned about is liability and not injuries. On more than one occasion. So when liability questions have already been asked and the remaining attorneys agree no further liability questions are going to be asked those attorneys leave the deposition.