Hi EnviousStarfish54 ,
These settings are stored in your user profile on the server and should be reloaded when you open a new browser session. To make sure, I just tried that on the Demo Server 🙂
Do you see a different behavior?

the order is reset.

Looks like the order might not be stored - I'll ask the guys to check and add it to the bug list 🙂

seems not all settings are stored? for example if I add a custom column in hyperparameters and do a refresh

I'll check 🙂