you mean too many connection to the file server then I could not connect more?

yes, that's exact what I'm concerned. Maybe it's the problem, because we're sharing the same CLearml for several projects and we log many things in the console, Clearml captures all.

@<1523701070390366208:profile|CostlyOstrich36> Thanks for quickly response.

Are you trying to upload data to the files server

Yes, I 'm trying to upload to the files server using

The code I'm using:

ds = Dataset.create(
            dataset_name="xxxx",
            dataset_project=f"A/B/C",
            dataset_tags=[task_tag],
        )
        ds.add_files(path=ng_path)
        ds.upload()
        ds.finalize(verbose=True)

The full log is the attachment.

I got the same problem but I could fix it in the clearml.conf file. Please check the role, key, secretkey in clearml.conf file

Thanks, I got it working. The server need time to re-load.

Can't add because of confidential info!

well, we created a dataset with about 20k items, each file about 226 B (pretty small), all are JSON files. It worked fine for other PCs but 1 PC got this error.

We used code python to upload txt files to a Dataset on ClearML