My gut feeling is — if you've been operating on a set of power abilities until now, undoing it risks unravelling some previous character choices. So I'd be personally opposed on that principle.

But it's not really my call, and it doesn't affect anything broader plot linked (and again, the other characters will have the option to visit the area with magical trinkets too), so I don't object if it's something you're really keen on!