Hi EnormousWorm79 , are you using a self-hosted server?

Yeah, but I still need to update the links in the clearml server

Yes, I am using a self-hosted server.

So we ran some experiments(tasks) and uploaded the artifacts to local storage. We want to move them to a s3 storage

Furthermore we want to move existing datasets on one s3 server to another s3 server

What is your scenario? Can you elaborate?

around 100-200

For anyone else struggling with this:
Shell into the mongo container and run
db.task.find({ "project": "<PROJECT_ID>" }, { "execution.artifacts.$": 1 }).forEach(function (doc) { Object.keys(doc.execution.artifacts).forEach(function (k) { doc.execution.artifacts[k].uri = doc.execution.artifacts[k].uri.replace("old_host", "new_host"); db.task.updateOne({ _id: doc._id }, { $set: { execution: doc.execution } }) }) });

Well, that can be done by running a custom script on the server

Nice 🙂 👍

Yeah, but I still need to update the links in the clearml server

yes... how many are we talking about here?

You might be able to write a script to override the links ... wdyt?

That’s not as straightfoward as it might seem.. the clearml client lib handles artifacts as read only dict. I am not taking a look at changing the values directly in mongodb

You would also need to edit the links somehow that are connected to the task