Normally calling SetPanelOwner should have done the trick.
This sounds like it could be a bug.
I had a look at the code and I don't see why it wouldn't work. calling the SetPanelOwner function on the panel manager forces all the panel to be reinitialized. This forces the bindings to be reinitialized too. And it should rebind the input.
I'm afraid will need more context to be able to figure this out.
Also just to be sure, do you have to destroy your character? Usually characters are never destroyed. They are simply disabled and then reanabled when they spawn back. That not only could fix this issue, and make your game more performant. But it could also prevent other issues that can arise from destroying objects.