SucculentBeetle7 , can you please give an example of the pathing for an artifact?
Quite correct - these are stored in mogodb.
I think Anna means that if artifacts and models are stored on the clearml fileserver their path will contain the IP or domain of the fileserver. If you then move the fileserver to a different host, all the urls are broken since the host changed.
SuccessfulKoala55 do you have any example? I guess a lot of people face this issue
SuccessfulKoala55 Hey, for us artifact download urls, model download urls, images in plots and debug image urls are broken. In the linked example I can see a solution for the debug images and potentially plot images but cant find the artifacts and model urls inside ES. Are those urls maybe stored inside the mongodb? Any idea where to find them?
http://IP_address :port/pipeline/test_task.task_id/artifacts/test_artifact/test_artifact.pkl
like so :)
SucculentBeetle7 please give an example of the path that is given to you by the web interface :)
SucculentBeetle7 , this happens since the SDK uses the full URL of the registered image, when you use the fileserver but change its ip, you essentially break the links (this is why we recommend using a hostname, when possible). In order to change the urls to point to the new IP, you'll need to run a update_by_query
API call against the ElasticSearch instance used by the server.
Or, when I try to load a dataset from an old task, this is the error that I get:File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/datasets/dataset.py", line 835, in get raise ValueError('Could not load Dataset id={} state'.format(task.id)) ValueError: Could not load Dataset id=7d05e1cad34441799f79931337612ae1 state
See here for an example on how to do it: https://github.com/allegroai/clearml-server/issues/83
for example the path that is visible in the web interface in Artifacts/File Path