Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All - I Am Planning To Migrate From A Clear-Ml Hosted Instance To A Self Hosted Server As My Usage Is Low And Infrequent, But Would Still Like To Persist The Experiments That I Have Already Logged. Does Anyone Have Experience With This, Have Written So

Hi all - I am planning to migrate from a clear-ml hosted instance to a self hosted server as my usage is low and infrequent, but would still like to persist the experiments that I have already logged. Does anyone have experience with this, have written some code to extract what is necessary or maybe some best practices to share? all input is greatly appreciated - thanks in advance!

  
  
Posted one month ago
Votes Newest

Answers 3


Hi StickyShrimp60
The best way is through APIs, you can query all the Tasks and then one by one use task.export_task with task.get_reported_scalars , task.get_reported_plots, task.get_reported_console_output, to get the details, after that you can recreate thee Task with import_task, and manually report the scalars/plots/console

btw: is self hosted server cheaper than the 15$ a month hosted service, or is it just a convenience

  
  
Posted one month ago

Hi AgitatedDove14 - thanks a lot for the input, I will have a look at the API

btw: is self hosted server cheaper than the 15$ a month hosted service, or is it just a convenience

ClearML is quite cheap for sure, but our monthly runs to something like 200$ (we have 4 users and some 14GB of metrics store that we want to maintain). The main point for us is that we do not use ClearML on a daily basis. It is maybe 6 months since we last used it and we are probably going to start using it again for new experiments in the coming 6 months, but by self-hosting we can just stop the aws instance when not needed and pay a fraction of the 200$/month fors torrage.

  
  
Posted one month ago

Yeah that makes sense, I mean it will probably be a bit more than that per month when it's up but half when it's down (just fyi, when AWS instances are down you still pay for the EBS storage).
If you are trying o save a buck here, double check on that otherwise you will end at the same cost level but after spending resource on migrating.
If you want a good hack you can always download the data and then just store it locally (i.e. half the migration job) and just reduce the number of users when the account is not being used, probably less work and cheaper 🙂

  
  
Posted one month ago
196 Views
3 Answers
one month ago
one month ago
Tags