Reputation
Badges 1
7 × Eureka!Thanks, I got it working. The server need time to re-load.
We used code python to upload txt files to a Dataset on ClearML
well, we created a dataset with about 20k items, each file about 226 B (pretty small), all are JSON files. It worked fine for other PCs but 1 PC got this error.
@<1523701070390366208:profile|CostlyOstrich36> Thanks for quickly response.
Are you trying to upload data to the files server
Yes, I 'm trying to upload to the files server using
The code I'm using:
ds = Dataset.create(
dataset_name="xxxx",
dataset_project=f"A/B/C",
dataset_tags=[task_tag],
)
ds.add_files(path=ng_path)
ds.upload()
ds.finalize(verbose=True)
The full log is the attachment.
yes, that's exact what I'm concerned. Maybe it's the problem, because we're sharing the same CLearml for several projects and we log many things in the console, Clearml captures all.
you mean too many connection to the file server then I could not connect more?
I got the same problem but I could fix it in the clearml.conf
file. Please check the role, key, secretkey in clearml.conf
file