I believe i have found the issue. I previously had my clearml host as localhost While fixing my setup little by little, i changed this to the local ip of my machine. Unfortunnately as shown in this picture, the link was not updated, is there a way to achieve this ?
Hi @<1660817806016385024:profile|FantasticMole87> , you'll either have to re-run it or change something in the DB. I suggest the first option.
In the end the data is physically uploaded somewhere and ClearML keeps the link to it. What would you suggest?
Haven't played enough with it to have a clear answer to that. Haven't played with storage on minio yet, maybe this would fix it. But I found it misleading to have a link to something that does not exist anymore. As the fix is either to manually update the all database or to repush the dataset again, my opinion is that it would make more sense to have the standard adress configurable (let's say None ) and only store only the location to be happened Full%20Overview/.datasets/Fashion%20MNIST/Fashion%20MNIST.cf1e886ab64d4f94b83712fae1afc036/artifacts/data/dataset.cf1e886ab64d4f94b83712fae1afc036.z0nngd18.zipas example
The idea is that the server is not something that should be moved on a whim. Once you do setups you can test but once everything is setup it is expected that the server will remain in the same address.
Also, this is when you're using the files server. If you were using minio from the start this would be a non issue.
Understood, i am still experimenting with the tool, i will check with minio afterwards ton confirms ! Thanks a lot for the quick response !
That is indeed what i ended up doing, it does mean that any migration would lead to a corrupted DB just like mine. Wouldn't it make more sense to build this link from a env var instead in future versions ?