Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All, I Have Deployed A Clearml Server With Docker To One Of Our Local Machine. I Had Set Up The Filesserver Folder As Mount Point To The Cloud. How Easy Is It To Migrate Our Existing Experiments Later On To A Clearml Server That We Deploy In The Cloud

Hi all, I have deployed a clearml server with docker to one of our local machine. I had set up the filesserver folder as mount point to the cloud.
How easy is it to migrate our existing experiments later on to a clearml server that we deploy in the cloud ? Or if we decide to go with a clearml paid plan, how easy is it to migrate existing experiment ? What are the step that would involve ?

  
  
Posted 10 months ago
Votes Newest

Answers 18


In summary:
Spin down the local server
Backup the data folder
In the cloud, extract the data backup
Spin up the cloud server

  
  
Posted 10 months ago

nevermind, all the database files are in data folder

  
  
Posted 10 months ago

I am more curious about how to migrate all the information stored in the local clearml server to the clearml server in the cloud

  
  
Posted 10 months ago

but when I spin up a new server in the cloud, that server will have it's own mongodb and that will be empty no ?

  
  
Posted 10 months ago

follow the backup procedure, it is basically the same process

  
  
Posted 10 months ago

Correct

  
  
Posted 10 months ago

Oh, I was assuming you are passing the entire DB backups to the cloud.
Are you saying you just want the file server on the cloud ? if this is the case, I would just use S3

  
  
Posted 10 months ago

I understand to from the agent, point of view, I just need to update the conf file to use new credential and new server address.

  
  
Posted 10 months ago

You mean not the entire DB?

  
  
Posted 10 months ago

Mongo db data migration?

  
  
Posted 10 months ago

Hi @<1576381444509405184:profile|ManiacalLizard2>
If you make sure all server access is via a host name (i.e. instead of IP:port, use host_address:port), you should be able to replace it with cloud host on the same port

  
  
Posted 10 months ago

So if i spin up a new clearml server in the cloud and use the same file server mount point, i will see all task and expriment that i had on the in prem server in the cloud server?

  
  
Posted 10 months ago

Basically the links to the file server are saved in both mongo and elastic, so as long as these are host:ip based, at least in theory it should work

  
  
Posted 10 months ago

I really like how you make all this decoupled !! 🎉

  
  
Posted 10 months ago

What about migrating existing expriment in the on prem server?

  
  
Posted 10 months ago

Are you talking about this: None
It seems to not doing anything aboout the database data ...

  
  
Posted 10 months ago

Oh, I was assuming you are passing the entire DB backups to the cloud.

Yes, that is what I want to do.
So I need to migrate both the MongoDB database and elastic search database from my local docker instance to the equivalent in the cloud ?

  
  
Posted 10 months ago

Anything else to migrate ?

  
  
Posted 10 months ago
630 Views
18 Answers
10 months ago
10 months ago
Tags