Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Ist It Possible To Move Artifacts From Local Storage To S3? Or Do I Have To Delete The Old One And Create A New One With A Location In S3?

Ist it possible to move artifacts from local storage to s3? Or do I have to delete the old one and create a new one with a location in s3?

  
  
Posted one year ago
Votes Newest

Answers 12


Hi EnormousWorm79 , are you using a self-hosted server?

  
  
Posted one year ago

Yeah, but I still need to update the links in the clearml server

  
  
Posted one year ago

Yes, I am using a self-hosted server.

So we ran some experiments(tasks) and uploaded the artifacts to local storage. We want to move them to a s3 storage

Furthermore we want to move existing datasets on one s3 server to another s3 server

  
  
Posted one year ago

What is your scenario? Can you elaborate?

  
  
Posted one year ago

around 100-200

  
  
Posted one year ago

For anyone else struggling with this:
Shell into the mongo container and run
db.task.find({ "project": "<PROJECT_ID>" }, { "execution.artifacts.$": 1 }).forEach(function (doc) { Object.keys(doc.execution.artifacts).forEach(function (k) { doc.execution.artifacts[k].uri = doc.execution.artifacts[k].uri.replace("old_host", "new_host"); db.task.updateOne({ _id: doc._id }, { $set: { execution: doc.execution } }) }) });

  
  
Posted one year ago

Well, that can be done by running a custom script on the server

  
  
Posted one year ago

Nice ๐Ÿ™‚ ๐Ÿ‘

  
  
Posted one year ago

Yeah, but I still need to update the links in the clearml server

yes... how many are we talking about here?

  
  
Posted one year ago

You might be able to write a script to override the links ... wdyt?

  
  
Posted one year ago

Thatโ€™s not as straightfoward as it might seem.. the clearml client lib handles artifacts as read only dict. I am not taking a look at changing the values directly in mongodb

  
  
Posted one year ago

You would also need to edit the links somehow that are connected to the task

  
  
Posted one year ago
357 Views
12 Answers
one year ago
10 months ago
Tags