If Bran's quest isn't done, I don't think Snow will be dragging him back to Castle Black.

A) Locke will be revealed, and it will be apparent that Bran isn't safe south of the wall

B) Bran is super stubborn and hard headed-- he's not going to just give in because Snow is older or whatever. Think about him sending Osha off with Rickon.