The spirit gems no longer work.

I swapped my weapon for a stronger one — all the heralds stopped working;
I switched back to the old weapon — they still don’t work;
My agility and strength stats meet all the requirements;
Lower-level heralds (level 7) work, but levels 10–12 don’t;
What could be the problem?