Yeah, but I still need to update the links in the clearml server

yes... how many are we talking about here?

You might be able to write a script to override the links ... wdyt?

Well, that can be done by running a custom script on the server

Yeah, but I still need to update the links in the clearml server

around 100-200

Yes, I am using a self-hosted server.

So we ran some experiments(tasks) and uploaded the artifacts to local storage. We want to move them to a s3 storage

Furthermore we want to move existing datasets on one s3 server to another s3 server

You would also need to edit the links somehow that are connected to the task

Hi EnormousWorm79 , are you using a self-hosted server?

What is your scenario? Can you elaborate?

For anyone else struggling with this:
Shell into the mongo container and run
db.task.find({ "project": "<PROJECT_ID>" }, { "execution.artifacts.$": 1 }).forEach(function (doc) { Object.keys(doc.execution.artifacts).forEach(function (k) { doc.execution.artifacts[k].uri = doc.execution.artifacts[k].uri.replace("old_host", "new_host"); db.task.updateOne({ _id: doc._id }, { $set: { execution: doc.execution } }) }) });

That’s not as straightfoward as it might seem.. the clearml client lib handles artifacts as read only dict. I am not taking a look at changing the values directly in mongodb

Nice 🙂 👍