Hi @<1554275773496430592:profile|DeliciousRaven95> , just to make sure I understand, you wish to make the fileserver store the actual data on NFS? Is that's the case, you'll need to set a PVC for the appropriate driver (using the correct storage class)
If however your aim is to place data directly in the storage (not using upload/download) and than refer to it using a Dataset, I'm not sure that's possible - ClearML Dataset bundles data and automatically uploads/downloads it
Hi @<1554275773496430592:profile|DeliciousRaven95> , ClearML will only show registered datasets
@<1554275773496430592:profile|DeliciousRaven95> , in general the data in datasets is bundled and zipped, you can add visualization manually on to of it. Is what what you're referring to?
Also 1 more question, can we have more than one storage options , a secondary storage maybe. if yes which changes need to be performed.
You can. But that would entail creating a new dataset with output_uri pointing to the new location
Thanks for the answer! If I set a PVC is it possible that the data(datasets) present in it will automatically be visible in Datasets tab ?
No, I wanted to have my data (in folders) to be visible in the dataset tab. So If I manually add a dataset (many excels), in a folder, and copy that folder to NFC, will it automatically be available in dataset tab? or do I need to perform some action
for example: I copy a folder (which has data) from my local machine to file share, would it be visible automatically in the clearml data tab, or I need to upload the data using Dataset class
Also 1 more question, can we have more than one storage options , a secondary storage maybe. if yes which changes need to be performed.
So If I manually add a dataset (many excels), in a folder, and copy that folder to NFC
How would you do that?
