Persistant Gem (Blink) Bug

Having Blink on a second weapon set and swapping from your main weapon to your weapon set that has blink sometimes causes it to be unusable and you also don't roll or say the "I need more time" quote. You just stand in place like it's on cooldown but it will never come off.
Unsocketing and resocketing the gem fixes the problem every time. Although in temple of chaos especially after the end of every tier and boss fight it happens an outrageous amount of the time. Sometimes blink still works, sometimes not. Some runs I could swap to it and there were no problems at all the whole run. Other runs after every tier or boss, picking up soul cores, using a lever, picking a new curse modifier it would just not let me blink. Some runs it works then doesn't then works again. So resocket and like magic blinks usable again.
I have a wand and focus as set 1 and a staff on set 2. Set 2 is purely blink, convalescence and sigil of power. However unlike blink sigil and convalescence work 100% of the time.