Shield Charge bug

I have the same problem. I use shield charge in weapon set 2 and most of my other abilities in weapon slot 1. shield charge randomly stops working until I unequip/re-equip the gem or portal out. Very frustrating, especially in boss fights where I use it a lot.