Hi CostlyElephant1 , where is the data stored? on the fileserver or some s3 bucket or other solution?
yes, the network seems fine. And it finally ends by getting the dataset. It just seems to hang more than it should between zips files.
We are thinking to host our own server later on, so this wont be a problem in that case? but I was asking just know what was going on. thanks again
CostlyElephant1 I'm sure it will be faster if the server is closer to you, but if you're going to store lots of GBs I think using some object storage (like S3, or locally hosted minio, for examples), makes more sense (and will also take some load off the clearml server who's main job is serving your experiments and dashboards)
