Disconnecting from Temple during party play

On multiple occasion both me and the party leader got disconnect from the game during party play while running his temple. When we came back in, we got rolled back by a couple of rooms, lost access to the temple and his temple closed and bomb his rooms. We were running 60 - 70 rooms temple. Lost access and loot due to this issue and can't enjoy party play.