SucculentBeetle7 , this happens since the SDK uses the full URL of the registered image, when you use the fileserver but change its ip, you essentially break the links (this is why we recommend using a hostname, when possible). In order to change the urls to point to the new IP, you'll need to run a update_by_query API call against the ElasticSearch instance used by the server.
I think Anna means that if artifacts and models are stored on the clearml fileserver their path will contain the IP or domain of the fileserver. If you then move the fileserver to a different host, all the urls are broken since the host changed.
SucculentBeetle7 , can you please give an example of the pathing for an artifact?
http://IP_address :port/pipeline/test_task.task_id/artifacts/test_artifact/test_artifact.pkl like so :)
SucculentBeetle7 please give an example of the path that is given to you by the web interface :)
Quite correct - these are stored in mogodb.
SuccessfulKoala55 Hey, for us artifact download urls, model download urls, images in plots and debug image urls are broken. In the linked example I can see a solution for the debug images and potentially plot images but cant find the artifacts and model urls inside ES. Are those urls maybe stored inside the mongodb? Any idea where to find them?
See here for an example on how to do it: https://github.com/allegroai/clearml-server/issues/83
SuccessfulKoala55 do you have any example? I guess a lot of people face this issue
Or, when I try to load a dataset from an old task, this is the error that I get:File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/datasets/dataset.py", line 835, in get raise ValueError('Could not load Dataset id={} state'.format(task.id)) ValueError: Could not load Dataset id=7d05e1cad34441799f79931337612ae1 state
for example the path that is visible in the web interface in Artifacts/File Path