Bugged weapon set passives?

I'm running a hybrid Wolf/Caster Druid build. And I THOUGHT I had set up my weapon set passives... But, now I've found that every time that I've try to set the passives, they reset back to a previous state. I have set the passives 3 times at Doryani, and every time, it looks like they're setup correctly, but then if I transition areas, they reset back to what they were before.
Am I doing something wrong, or is this super bugged? Or... Maybe both?

After some more testing: I did get the passives to "save". I had to refund the points at Doryani, AND then spend them on the weapon set passives. If I tried to do it all at once (which, the game let me do), it would look like it worked until I logged out or transitioned areas, at which point it would revert the passives.