Hi JitteryRaven85

I have also deleted some hyper-params but they appear again when training starts.

Yes you cannot "delete" parameters, as any missing parameter is synced back (making sure you have a full log).

The problem is that when I clone an experiment and change the hyper params some change and some remain the same

Could you expand on which parameters stay the same ? (obviously this should not happen)