Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All, I Have Deployed A Clearml Server With Docker To One Of Our Local Machine. I Had Set Up The Filesserver Folder As Mount Point To The Cloud. How Easy Is It To Migrate Our Existing Experiments Later On To A Clearml Server That We Deploy In The Cloud

Hi all, I have deployed a clearml server with docker to one of our local machine. I had set up the filesserver folder as mount point to the cloud.
How easy is it to migrate our existing experiments later on to a clearml server that we deploy in the cloud ? Or if we decide to go with a clearml paid plan, how easy is it to migrate existing experiment ? What are the step that would involve ?

  
  
Posted one year ago
Votes Newest

Answers 18


Oh, I was assuming you are passing the entire DB backups to the cloud.

Yes, that is what I want to do.
So I need to migrate both the MongoDB database and elastic search database from my local docker instance to the equivalent in the cloud ?

  
  
Posted one year ago

Basically the links to the file server are saved in both mongo and elastic, so as long as these are host:ip based, at least in theory it should work

  
  
Posted one year ago

I really like how you make all this decoupled !! 🎉

  
  
Posted one year ago

Mongo db data migration?

  
  
Posted one year ago

In summary:
Spin down the local server
Backup the data folder
In the cloud, extract the data backup
Spin up the cloud server

  
  
Posted one year ago

So if i spin up a new clearml server in the cloud and use the same file server mount point, i will see all task and expriment that i had on the in prem server in the cloud server?

  
  
Posted one year ago

but when I spin up a new server in the cloud, that server will have it's own mongodb and that will be empty no ?

  
  
Posted one year ago

You mean not the entire DB?

  
  
Posted one year ago

follow the backup procedure, it is basically the same process

  
  
Posted one year ago

Are you talking about this: None
It seems to not doing anything aboout the database data ...

  
  
Posted one year ago

I am more curious about how to migrate all the information stored in the local clearml server to the clearml server in the cloud

  
  
Posted one year ago

Hi @<1576381444509405184:profile|ManiacalLizard2>
If you make sure all server access is via a host name (i.e. instead of IP:port, use host_address:port), you should be able to replace it with cloud host on the same port

  
  
Posted one year ago

nevermind, all the database files are in data folder

  
  
Posted one year ago

What about migrating existing expriment in the on prem server?

  
  
Posted one year ago

Anything else to migrate ?

  
  
Posted one year ago

I understand to from the agent, point of view, I just need to update the conf file to use new credential and new server address.

  
  
Posted one year ago

Correct

  
  
Posted one year ago

Oh, I was assuming you are passing the entire DB backups to the cloud.
Are you saying you just want the file server on the cloud ? if this is the case, I would just use S3

  
  
Posted one year ago
1K Views
18 Answers
one year ago
one year ago
Tags