Hi @<1554275773496430592:profile|DeliciousRaven95> , ClearML will only show registered datasets
Thanks for the answer! If I set a PVC is it possible that the data(datasets) present in it will automatically be visible in Datasets tab ?
Hi @<1554275773496430592:profile|DeliciousRaven95> , just to make sure I understand, you wish to make the fileserver store the actual data on NFS? Is that's the case, you'll need to set a PVC for the appropriate driver (using the correct storage class)
No, I wanted to have my data (in folders) to be visible in the dataset tab. So If I manually add a dataset (many excels), in a folder, and copy that folder to NFC, will it automatically be available in dataset tab? or do I need to perform some action
Also 1 more question, can we have more than one storage options , a secondary storage maybe. if yes which changes need to be performed.
You can. But that would entail creating a new dataset with output_uri pointing to the new location
Also 1 more question, can we have more than one storage options , a secondary storage maybe. if yes which changes need to be performed.
So If I manually add a dataset (many excels), in a folder, and copy that folder to NFC
How would you do that?
for example: I copy a folder (which has data) from my local machine to file share, would it be visible automatically in the clearml data tab, or I need to upload the data using Dataset class
@<1554275773496430592:profile|DeliciousRaven95> , in general the data in datasets is bundled and zipped, you can add visualization manually on to of it. Is what what you're referring to?
If however your aim is to place data directly in the storage (not using upload/download) and than refer to it using a Dataset, I'm not sure that's possible - ClearML Dataset bundles data and automatically uploads/downloads it