Game Crashing on console in multiplayer

There seems to be an issue with the game freezing up when in a multi-player game on the xbox. We have tried changing settings on the graphics page, that does not help. We thought maybe it had to do with who created the area instance, but that does not seem to be the case either.

One build is a druid plant build
The other build is the Sorc mage build with Powered Zealots.

We cannot tell if it is related to so much going on with graphic but basically the game will freeze for a player and you have to exit and restart the game to fix it. It is making multiplayer almost impossible to play.