I switched from Iaido to Aikido and started from white belt again.

It goes with the switch.

You have not lost anything. You would be gaining new.