Reputation
Badges 1
37 × Eureka!Cam you perhaps send the docker-compose in the current server? (已編輯)
Sorry I don't undestand what' your meaning...
I want to use clearml, the old one's mongo is 3.65...
I tried as below, it can works fine:
copy(scp) /opt/trains to target machine upgrade mongo by this: https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server_mongo44_migration/ mv /opt/trains /opt/clearml Increase vm.max_map_count
;Grant access to the Dockers; get lastest docker-compose.yml and pull/upBut the web ui dashboard is still weird, anyway it can work now
Sorry , my poor english, it means upgrade by script.
Good news is it's fine now, I try to upgrade ES (although it fails), and i try to go through the necessary steps in this: https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server_linux_mac
Maybe plotly dash can help, is there is any other solution?
Hi GrumpyPenguin23 ,
Thanks your reply.
In 2, dose that mean i should develop another tool to parse the json standalone? 3 is a good solutionAnd i think what i actually need is the solution to integrate application based server,such as plotly dash or bokeh server in web ui?
GrumpyPenguin23
It seems the solution 3 is the fastest way, and i can reuse my code easily. It works now~ That's quite interesting, but the learning curve seems a bit steep for me.Do you have any material or suggestion for learning that?
I found plotly dash cannot be exported to html file, so it may cannot be used here
GrumpyPenguin23 Ok, i will open a request now!
AppetizingMouse58 Thanks so much!, Could u tell why does this happen? If it happen next time , is there any other solution?
And i try to upgrade elastic by your script, but it cannot success, the log shows :
SuccessfulKoala55 Ok, thanks, i will have a try.
SuccessfulKoala55 Thanks for your reply, How can i fix this?
SuccessfulKoala55 I get all the trains server experiments record in new clearml server. Maybe it's due to vm.max_map_count or access of /opt/clearml, or the failed ES upgrade...
Hi SuccessfulKoala55 I have run this in step 2
HI: AgitatedDove14
2. I mean if my server break down, and i start a new server in another machine, can i migrate my backup experiments to the new server?
3. Not only change the info in web ui, can i connect to the old experiment , and report a new graph to that?
SuccessfulKoala55 Thanks, If restarting server wont stop running experiments, then what i say is not necessary !
AppetizingMouse58 Ok, this is the full log, here seems a error:
AgitatedDove14 OK, i see, thanks so much!
CostlyOstrich36 I'm afraid even i change to ClearML, the problem still exists...
AppetizingMouse58 After i modify the max_buckets to 200000000000, I cannot see any information in web ui. Here is the log:
My docker-compose is lateset, download by this:curl
https://raw.githubusercontent.com/allegroai/clearml-server/master/docker/docker-compose.yml -o /opt/clearml/docker-compose.yml
AppetizingMouse58 here:
here is my old docker-compose
SuccessfulKoala55 AppetizingMouse58 I delete logs/apiserver.log, and restart the server , and here is the log. It show cannot connect to ElasticSearch
SuccessfulKoala55 And i try to create ~/trains.conf with verify_certificate = False, but i still cannot init task, it seems doesn't work for the version i'm using.
Hi SuccessfulKoala55 I find why the ES version is not upgraded to 7.16, because the script provided here is 7.6 https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server_es7_migration