Bug - Trial of Chaos, multiple players, and the elevators

The elevators in Trial of Chaos are quite annoying for parties more than 2.

They go up and down without 1 or 2 of the players.

Please triage some better way of handling this. Its frequent that somebody or multiple people get stuck behind and its just goofy.